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Preface 



Relay feedback has attracted considerable research attention for more than a 
century. The classical work of Typikin (1984) on analysis summarizes progress 
up to the 1960s. Early applications of relay systems ranged from stationary 
control of industrial processes to control of mobile objects. In the 1950s, relays 
were mainly used as amplifiers but such applications are now obsolete, owing to 
the development of electronic technology. In the 1960s, relay feedback was ap- 
plied to adaptive control. One prominent example of such an application is the 
self-oscillating adaptive controller developed by Minneapolis Honeywell, which 
uses relay feedback to attain a desired amplitude margin. It was in the 1980s 
that Astrdm and Hagglund successfully applied the relay feedback method to 
auto-tune PID controllers for process control, and triggered a resurgence of 
interest in relay methods, including extensions of the method to more complex 
systems. Since then, new tools and powerful results have emerged. 

The present monograph presents, in a single volume, a fairly comprehensive, 
up-to-date and detailed treatment of relay feedback theory, use of relay feedback 
for process identification, and use of identified models for control system design. 
The materials included here are based on research results of the authors and 
their co-workers in the domain. Both single- variable and multivariable systems 
are addressed. For presentation, we have made the technical development of the 
results as self-contained as possible. Only knowledge of linear system theory 
is assumed for readers. Illustrative examples of different degrees of complexity 
are given to facilitate understanding. Therefore, it is believed that the book 
can be accessed by graduate students, researchers and practising engineers. 

The table of contents gives an idea of what is contained in the book. The 
book is organized into three parts: Part I Analysis of Relay Feedback Systems, 
Part II Process Identification Using Relay Feedback, and Part III Controller 
Design. The three parts are related but can be read independently. Those who 
are only interested in relay applications can skip Part L A chapter-by-chapter 
preview of our materials is given as follows. 




VI 
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Part I deals with analysis of relay feedback systems and consists of four 
chapters. Chapter 1 considers a SISO linear system with general relay feedback 
and studies the existence of solutions to the system. It is shown that existence 
and uniqueness of solutions are always guaranteed for the system with nonzero 
time delay; for the delay-free case, a necessary and sufficient condition is given 
for the existence of solutions. Chapter 2 deals with problems of the existence of 
limit cycles of linear systems with relay feedback, and presents some sufficient 
conditions. Moreover, if a limit cycle exists, necessary and sufficient condi- 
tions are given for determining particular limit cycles. The main tool used is 
Brouwer’s fixed point theorem and some techniques related to system theory. 
Chapter 3 studies the local stability problem of limit cycles for time-delay relay 
feedback systems with relays containing asymmetric hysteresis. It is shown that 
if a certain constructed matrix is Schur stable, then the local stability of the 
limit cycle considered is guaranteed. Chapter 4 investigates the global stability 
of limit cycles in relay feedback systems. A unified framework and results are 
presented for global convergence. The key idea is to reduce the global stability 
problem to the asymptotic stability of a discrete time system. 

Part II studies process identification from relay feedback and consists of 
four chapters. Chapter 5 deals with identifying process models from steady- 
state responses, or limit cycles, of relay feedback systems. We show that use 
of the FFT in place of the describing function approximation can give more 
accurate frequency response estimation. More cycles of oscillations can be em- 
ployed to enhance estimation robustness. Modified relays can enable estimation 
of more points on the process frequency response. Chapter 6 deals with identi- 
fying process frequency response by using transient responses of relay feedback 
systems. Chapter 7 considers the problem of converting the frequency response 
identified from relay feedback to a transfer function with possible dead time. 
Chapter 8 develops a general identification procedure applicable to various test 
scenarios, covering step/relay and open-loop/closed-loop types. 

Part III is concerned with control system design and consists of four chap- 
ters. Chapter 9 considers control design for SISO stable processes. Internal 
model control design is reviewed. Its equivalent single-loop controller is derived 
and usually of high complexity. The model reduction technique is employed to 
find its approximation. Users have the option to choose between PID and high- 
order controllers to better suit the applications. It turns out that high-order 
controllers may be necessary to achieve high performance for essentially high- 
order processes. Chapter 10 extends the SISO methodology in Chapter 9 to the 
multivariable case. For internal model control, the objective closed-loop trans- 
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vii 

fer functions are characterized in terms of process unavoidable non-minimum- 
phase elements. A multivariable controller for best achievable performance is 
obtained using block diagram analysis and model reduction. Chapter 11 consid- 
ers control of unstable processes. The relay feedback test is used to identify an 
unstable process. An IMC-based single-loop controller design method is given 
to find the feedback controller in either PID or high-order form. Chapter 12 
presents a new scheme called the Partial Internal Model Control (PIMC), which 
is capable of controlling both stable and unstable processes. In the PIMC, a 
process model is expressed as the sum of stable and anti-stable parts and only 
the stable part of the process model is used as the internal model. The process 
stable part is cancelled by the internal model and the remaining anti-stable 
part is stabilized and controlled using a primary controller. Chapter 13 ad- 
dresses decentralized control of multivariable processes. A simple independent 
design method for multi-loop controllers is proposed which exploits process 
interactions for the improvement of loop performance. 

We would like to thank C. C. Hang, Q. Bi, B. Zou, Yu Zhang, Yong Zhang, 
H. W. Fung and X. P. Yang for their fruitful research collaborations with us, 
which have led to the contributions contained in the book. We are grateful to 
the Centre for Intelligent Control and Department of Electrical and Computer 
Engineering of the National University of Singapore for providing plenty of 
resources for our research work. 



Qing-Guo Wang 
Tong Heng Lee 
Chong Lin 
Singapore, June 2002 
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Part I 



Analysis of Relay Feedback Systems 




Introduction to Part I 



Relay systems can be traced back to their classical configurations. A description 
of various relay extremal control systems can be found in Morosanov (1964). 
Applications of relay systems range from stationary control of industrial pro- 
cesses to control of mobile objects. In the 1950s, relays were mainly used as 
amplifiers but such applications are now obsolete, owing to the development 
of electronic technology. In the 1960s, relay feedback was applied to adaptive 
control (Tsypkin, 1984). One prominent example of such applications is the 
self-oscillating adaptive controller developed by Minneapolis Honeywell which 
uses relay feedback to attain a desired amplitude margin. This system was 
tested extensively for flight control systems, and it has been used in several 
missiles. It was in the eighties that Astrom successfully applied the relay feed- 
back method to auto-tune PID controllers for process control, and triggered a 
resurgence of interest in relay methods, including extensions of the method to 
more complex systems. A recent survey of relay methods is provided in Astrom 
and Hagglund (1995). 

Theoretical development is far behind the practical applications of relay 
feedback systems (RFS). Difficulties in the analysis occur because such systems 
may exhibit such phenomena as non-uniqueness of solutions, sliding motion and 
bifurcation, fast switching or chattering and chaos. It is known that RFSs often 
possess limit cycles. This property is very useful in modern control applications 
such as controller automatic tuning. However, to establish exact conditions for 
the existence of a limit cycle is not an easy task. As a result, a limit cycle is 
pre- assumed to exist in some practical applications and theoretical analysis. 
The describing function method was initially used to investigate the existence 
problem (Tsypkin, 1984). This can only give an approximate analysis. Exact 
methods have been reported recently to determine the period of limit cycles 
with two switches per period (Astrom, 1995; Varigonda and Georgious, 2001). 

If a limit cycle exists, its stability is another important property which is 
also assumed in engineering practice. Classical techniques such as the phase- 
plane approach have been employed for the stability analysis of limit cycles 
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(Guckenheimer and Holmes, 1983; Tsypkin, 1984). Exact methods for analyz- 
ing the limit cycle stability of relay feedback systems have attracted much at- 
tention. Local stability results have been reported in Astrom (1995), Johansson 
et al. (1997) and Johansson et al. (1999), and are mainly based on consideration 
of the linear approximation of the Poincare map. The local stability property 
ensures that any nearby trajectory tends to the limit cycle as time goes to plus 
infinity. What is more meaningful in engineering practice is the global stability 
of limit cycles, which says that all system trajectories tend to the limit cycle as 
time goes to plus infinity. This problem was studied quite recently in Goncalves 
et al. (2001), and presents sufficient conditions in terms of a set of linear ma- 
trix inequalities by finding the so-called surface Lyapunov function of Poincare 
maps. Under specific assumptions, the result serves a class of relay feedback 
systems well. Other work is presented in Lin et al (2001) from a different point 
of view, where the system setting considered therein includes a time delay and 
the limit cycle is not assumed to be symmetric. 

Motivated by the above observations, recently we have devoted time to the 
analysis of linear systems with relay feedback under a general setting. These 
include the existence of solutions, the existence of limit cycles, and the local 
and global stability of limit cycles. The plant can have a time delay, the relay 
can contain asymmetric hysteresis, and the limit cycle can be asymmetric and 
have more than two switchings per period. Our results can serve a large class 
of relay feedback systems well. The results are for general SISO RFSs. Part I 
of this book is based on these latest results. 




1. Existence of Solutions 



This chapter considers a single-input single-output (SISO) linear system under 
relay feedback and studies the existence of solutions to the system. 



1.1 Introduction 

Relay feedback systems (RFSs) have been receiving much attention from re- 
searchers due to their extensive practical applications (Astrdm and Hagglund, 
1995; Tsypkin, 1984). Such systems appear as a special class of differential 
equations with discontinuous right-hand sides. For the latter differential equa- 
tions, the topic of well-posedness (i.e., existence and uniqueness of solutions) 
has been an important research area for several decades, and many results 
are summarized in Filippov (1988) from a unified standpoint. However, some- 
times these existing methods are difficult to adopt to deal with relay feedback 
systems. So far, few results have been reported addressing the existence of so- 
lutions to RFSs. In Georgiou and Smith (2000), the well-posedness problem is 
studied for systems having input-output forms. In Lootsma et al. (1999), by 
using the theory of Linear Complementarity Problem (Cottle et a/., 1992), an 
efficient sufficient condition is presented. The idea is to transform the system 
considered into a complementarity system and then solve the corresponding 
rational complementarity problem (Heemels et a/., 1999; Van der Schaft and 
Schumacher, 1998). The result therein is slightly improved by Lin and Wang 
(2002). We notice that the feedback considered therein is connected with an 
ideal relay and the control input is between two values at the switching in- 
stants, and that the well-posedness result does not apply to RFSs with two- 
valued relay feedback. The latter system setting has recently attracted much 
more attention, both theoretically and practically (Astrom, 1995; Goncalves et 
a/., 2001; Varigonda and Georgious, 2001). 

In this chapter, we present a detailed analysis of the existence of solutions 
to RFSs with two- valued relay feedback. Analyzing clearly the system solution 
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for all time t > 0 is not only helpful for characterizing the trajectories but also 
meaningful for the global convergence of RFSs. The system considered here 
is of a general setting: the plant can have a time delay, the relay can contain 
asymmetric hysteresis. It is shown that under some easy-check conditions, there 
is a solution for all time ^ > 0 starting from any initial condition. 

This chapter is organized as follows. Section 1.2 gives some preliminaries. 
Section 1.3 deals with the problem of the existence of solutions for r > 0 while 
Section 1.4 considers r = 0. 



1.2 System Formulation 



Consider a single-input single-output (SISO) plant described by 
x{t) = Ax{t) + bu{t — r) 

y(t) = cx{t) (1.1) 

where x{t) G E^, y(t) G E and u{t — r) G E are the state, output and control 
input, respectively; A, b,c are constant real matrices or vectors with appropriate 
dimensions; r > 0 stands for the time delay. The plant has relay feedback: 



I U(3, if y(t) > /?, or y{t) > a and u(t-) = Ufs 
u{t) = (1.2) 

I Wq;, if y{t) < O', or y{t) < j3 and u{t-) = 



where o;,^ G E with a < /3 indicating hysteresis; Ua^Uf^ G E and Ua ^ up. Due 
to time delay r > 0, we have to specify the initial function u{i) for i G [— r, 0]. 
The most natural one, which is used in practice, is: 






u{i) = 



Ua 5 



if y(0) > /? 
if 2/(0) < a 



\^uo eU,if a < 2/(0) < /? 



(1.3) 



where 



U := {ua, up). (1.4) 

We call (1.1)-(1.3) a RFS and denote it by Hr. 

Define the switching planes: 

5, := G E" : = a] , 

S0 :={e€R" : ci = P). 



Let 



(1.5) 

( 1 . 6 ) 
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<5+ a 


:= e M” 


cC > a} , 


(1.7) 


S-a 


:= € M" 


< a} , 


(1.8) 


S+0 


:= 6 K” 


S}, 


(1.9) 


S-0 


:= € R” 




(1.10) 



Suppose that x{t) is a solution to system Er with initial condition x(0) satis- 
fying ^(0) > a (resp. y{G) < a). If the trajectory of x{t) intersects Sa (resp. 
Sf^) at Xa (resp. Xj^) from 5+^ (resp. 5_^), we will call the state Xa (resp. x^) 
an intersecting point The time instant corresponding to the intersecting point 
is called an intersecting instant. It should be stressed that in our convention, if 
the trajectory of x{t) intersects Sa (resp. Sp) at x^ (resp. xp) from S-a (resp. 
5+/3), the state Xa (resp. xp) is not called an intersecting point and the cor- 
responding time instant is not the intersecting instant, since such intersecting 
does not cause any switch in u{t). If the trajectory of x{t) not only intersects 
but also traverses Sa (resp. Sp) at Xa (resp. xp) from S-^a (resp. S-p) to S-a 
(resp. 5+/3), we will call such an intersecting point Xa (resp. xp) a, traversing 
point The time instant corresponding to the traversing point is called a switch- 
ing instant See Figures 1.1 and 1.2, where Xi, Xs and X 4 are intersecting points 
(indeed xi and X 4 are traversing points) while X 2 and x^ are not. It should be 
noted that for r > 0, the relay u{t) will switch from up to u a (or from Ua to up) 
at a switching instant. But at this switching instant, u{t — r) in (1.1) remains 
Up (or Ua) for a time duration of r after which it changes to Ua (or up). 




Fig. 1.1. Intersecting points xi, X3, X4 and traversing points xi, X4 



In the next section, we will study whether or not a solution x(t) with initial 
state xo € exists for all t G [0, 00 ). We will see that a system trajectory 
of x{t) may have two different trajectories after some intersecting instant. We 
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Fig. 1.2. The corresponding curves for Figure 1.1 (a) y{t) = cx(t)\ (b) u{t) (solid) 
and u{t — r) (dashed) 

will call these trajectories sub-trajectories of x(^), and the corresponding system 
solutions sub-solutions. 

1.3 Existence of Solutions 

We see that during the time after a trajectory starts from the region or 
S-f 3 n S^a or S-a, but before it reaches any switching plane, the system Ur 
is a linear system with a fixed control u e U, and thus the existence and 
uniqueness of system solution is guaranteed for some nonzero time interval. So, 
to determine the existence of a solution for alH > 0, it is sufficient to study the 
trajectory characteristic at the moment it intersects the switching plane or 
<5a- 

Prom (1.1) — (1.3), u{—t) is uniquely specified by initial condition xq. If the 
unique trajectory of x{t) starting from xq does not intersect or Sa for all 
t > 0, then the relay remains u{—r) forever and x{t) obviously exists uniquely 
for all ^ > 0. If the trajectory of x{t) intersects or Sa, for r > 0, the 
solution x{t) can exist just after the intersecting instant while for r = 0 it may 
not. The following lemma is useful for characterizing the trajectory of x{t) at 
the intersecting points and analyzing the existence of solutions just after the 
intersecting instant. 
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Lemma 1.3.1. Consider system Ur- If the trajectory of x{t) starting from xq 
intersects Sp (or Sa) o,t intersecting point xi at the instant t\ > 0, then there 
is no sliding motion along Sp (or Sa) around the intersecting instant ti. 

Proof. We prove by contradiction. We take the case of cxq < a for example. 
(For the other cases, the proof is similar.) 

Since cxq < a, then from (1.1)-(1.3), the control remains Ua until the 
trajectory of x{t) intersects Sp at time ti > 0. Suppose there is sliding motion 
along Sf 3 just after the instant t\. Then, for the cases r > 0 and r = 0, there 
is a sufficiently small 5 > 0, such that the control remains Ua during the small 
time interval [ti — S, h + 6], and 

y{t) = cx{t) ^ /3, te[ti- 6, ti), (1.11) 

y{t) = cx{i) - P, te [ti, ti + (5]. (1.12) 

Since 5 > 0 is small, x{t) can be expanded as 
^ 1 

x{t) =xi + '^ A^{Axi + bu)(t - ii)*+^ + 0{t - Vfc = 0, 1, . . . 

From (1.12), it is easy to see that 
cA!'{^Ax\ + 6u) = 0, Vi = 0, 1, . . . 

which results in y(t) = cx(t) = ^ for all t e [ti, ti +5]. This contradicts (1.11). 
Hence, there is no sliding motion just after the instant ti . This completes the 
proof. 

Remark 1.3.1. We will see from Example 1.4.1 later that the trajectory of x{t) 
may not be available just after the intersecting instant t\ (i.e., x(t) exists on 
t G [0, ^i] only). If the trajectory of x{t) can evolve just after the intersecting 
instant ^i, by virtue of Lemma 1.3.1, the trajectory of x{t) has at most two 
sub-trajectories: one traverses (or Sa) at the intersecting point xi \ and one 
returns to S-^ (or 5+a). 

It should be pointed out that Lemma 1.3.1 excludes the existence of sliding 
modes at the intersecting points only, but a sliding motion may occur at other 
points. See the following simple example. 

Example 1.3.1. Consider system Ur with r = 0.5 and 




Up = —1, Ua = 1, /? = 1, a = —0.5. 
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Letting xq = [1 1]^ and u{t — r) = \/t G [ 0 , r ], we have x{t) = [1 and 

y{t) = 1 for alH > 0 and the control remains the same u = Ujs forever. So, the 
trajectory of x{t) starting from xq has a sliding motion. But this trivial case 
does not conflict with Lemma 1.3.1, because xq is not an intersecting point. 

For the case r > 0, let us look into the system trajectory characteristics 
in more detail. Due to r > 0, by Lemma 1.3.1, the trajectory of x{t) starting 
from Xq exists uniquely until it intersects or Sa at time at the intersecting 
point Xi. If ti = 00, the solution x{t) exists obviously for all ^ > 0; if ti is finite, 
then at xi, the trajectory of x{t) or (case 1) is tangent to <S /3 or Sa and then 
returns to S-^ or S-^a with the control input unchanged, or (case 2) traverses 
<S /3 or Sa with the control input changed to another value after time duration 
r. If the trajectory of x{t) follows case 1, it will uniquely exist until intersecting 
Sp or Sa again, at which intersecting point either case 1 happens again or it 
follows case 2. We concentrate on case 2 now. In this case, the phenomenon 
of early switching^ may occur, which happens if t 2 — h < r. Regarding this, 
we have the following statement, which says that, at most, a finite number of 
switchings occur during a time interval of length r. 

Lemma 1.3.2. Let x{t) he a solution to system Ur r > 0, which has its 
trajectory in [0, S] with (5 G (0, oo). Let T > 0 he any time instant satisfying 
T + r G [0, (^]. Then, during the time interval [T, T + r], there are at most a 
finite number of early switchings. 

Proof. We prove by contradiction. Suppose there are an infinite number of 
early switchings during the time interval [T, T + r] with the control remaining 
u gU. Then, there are consecutive traversing points Xai G <5^, G S^s and 
scalars (Jq;* > 0, > 0, such that the trajectory of x{t) spends time duration 

Sai from Xai to Xi 3 i and then spends S^i from x^i to Xa(i-^i) (i = 1, 2, . . .). We 
have 

Xj3i = + f 

Jo 

giving 

pSoci 

X/3i - Xai = - I)Xai + / huds. 

Jo 

Since ^ it holds that Sai — ^ 0 and 0 as i — >■ oo. Noting 

that Xai is bounded due to the boundedness of x{t) for t G [T, T + r], the 
above yields 

^ An early switching means that the time duration between two successive switching 
instants is no more than r. 
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lim c{x0i - Xai) =0 
i->oo 

which contradicts 

cx^i = ^ > a - cxoci, Vi = 1, 2, 

This proves the lemma. 

From the above easy analysis, the result for r > 0 can be obtained. 

Theorem 1.3.1. Consider system Er with r > 0. Then, for any initial con^ 
dition x(0) G there exists a unique solution x{t) for all t G [0, oo). 

Proof Recall that for any initial condition x(0) G u{—r) is uniquely spec- 
ified. So the solution x{t) uniquely exists for t G [0, r]. After that (i.e., t > r), 
the control input u{t — r) is still uniquely specified due to r > 0. By virtue of 
Lemma 1.3.2, during any finite time duration, there are at most a finite number 
of switchings. These implies that x{t) exists uniquely for all ^ > 0. 

In Example 1.3.1, although the trivial case cts stated there occurs, it is easy 
to verify that for any initial condition, there exists a unique solution for all 
t > 0. 



1.4 Delay- free Case 



For system Er with r = 0, it is not easy to study the system solutions. For a 
given initial condition xq, although there exists a unique solution x{t) for some 
time interval [0, 6] ((5 > 0), the trajectory of x{t) may not be available just 
after it intersects the switching plane, or may have some sub-trajectories at an 
intersecting point. Let us examine the following examples. 



Example 1.4^T Consider system Er with r = 0 and 



A = 



-1 0 
0 -1 



, 6 = 



, c = [1 0], 



= —1, Ua = 1, P — 0.5, a = —0.5. 



We check that for any initial condition xo, the trajectory of x{t) starting from 
xq will intersect or for the first time at some time ti . However, it is easy 
to check that the solution x{t) exists only for t G [0,^i]. After the instant t\, 
no extended solution satisfying (1.1)-(1.3) is available. 
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Example 1.4-2. Consider system Er with r = 0 and 



A = 



Up 



-5 1 0 




1 


-8 0 1 


, i = 


0 


-4 0 0 




4 


3, U(x == 


2, 0 = 


1, 



, c = [l 0 0], 



a = —0.5. 



Let the initial condition be xq = [—2.2767 3.5097 — 2.4348]^. Then u{0) = 
Uoc = 2. We check that the trajectory of x{t) starting from xq intersects Sp 
at the intersecting point xi = [1 3 2]^ at the instant ti = 0.6. After instant 
^ 1 , there are two sub-trajectories: one traverses Sp with the relay switching 
to u /3 = 3 (see the dashed line in Figure 1.3); the other one returns to S-p 
with the relay remaining unchanged, and traverses Sp at the traversing point 
X 2 = [1 3.5934 10.9780]^ at the instant t 2 = 2.423 (see the solid line in Figure 
1.3). 



u 



3.2 



2.8 

2.6 



2.2 

2 

1.8 



0.5 



1.5 



2.5 



3.5 



4.5 




Fig. 1.3. Occurrence of two sub-trajectories for Example 1.4.2 



It is seen from Example 1.4.1 that, for delay-free RFSs (i.e., r = 0), a 
trajectory may not evolve after it intersects Sp or Sa- In the following, we 
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will seek conditions which ensure that the trajectory evolves just after the 
intersecting instants. 

Recall that given any initial condition xq G it(0) G ZY is well-defined 
and there exists a unique solution x{t) to (1.1)-(1.3) at least for t G [0, Si] 
(5i > 0) during which it holds that u{t) = u(0). Obviously, if no intersecting 
point is available for all t > 5i, then the solution x{t) is unique for alH > 0 
with u{t) = u(0). Otherwise, can be extended to ti, where t\ is the first 
intersecting time taken for the trajectory of x{t) to go from xq to the first 
intersecting point xi G Sjs (or x\ G So)- Note that after the instant ^i, x{t) 
may not be available. Alternatively, if x(t) can extend its trajectory just after ^i, 
then by Lemma 1.3.1 there is at most two sub-trajectories (Remark 1.3.1). We 
also denote any possible corresponding sub-solution by x{t). Then x{i) exists 
at least for t G [0, ti +^ 2 ] for some ^2 > 0. Again, 62 can be extended to infinity 
(if there are no more intersecting points) or to t 2 > <^ 2 ? where t 2 is the time x{t) 
taken going from xi to the next intersecting point X 2 G Sa (or X 2 G 5^). So, 
whether or not a solution x{t) (perhaps a sub-solution) starting from xq can 
extend its trajectory is related to the information at the intersecting points. The 
following theorem gives a necessary and sufficient condition for the existence 
of solutions just after any intersecting instant. Let 

A^={0,l,...,n-1}. (1.13) 



Theorem 1.4.1. Consider system Ur with r = 0. 

(i) Suppose that a solution x{t) has an intersecting point x{ts) — G Sp 
in its trajectory. Then, the trajectory of x{t) can evolve further after instant ts 
if and only if either there exists ni2 G such that 



-h cA^hufs = 0, i = 0, 1, . . . , ni2 - 1, 
cA^12 + 1x/ 3 -h cA^^‘^hU(3 > 0, 
holds, or there exists an odd nn G Af such that 



(1.14) 



-f cA^buoc = 0, i = 0, 1, . . . , nn — 1, 

+ _|_ cA^^^hUa < 0 



(1.15) 



holds, or both (1A4) hold. 

(a) Suppose that a solution x{t) has an intersecting point x{ts) — Xa G Sa 
in its trajectory. Then, the trajectory of x{t) can evolve further after instant ts 
if and only if either there exists nn G J\f such that 



cA^'^^Xa + cA^bUa =0, 2 = 0, 1, ... , TT-n — 1, 

cA^ii+i^cK 4- cA^^^bUa < 0, 



(1.16) 
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holds j or there exists an odd ni 2 £ Af such that 

+ cA^bu^ 0, i = 0, 1, . . . , ni2 - 1, 

cA’^i 2 + 1 xq, + > 0 

holds, or both (1.16) and (1.17) hold. 



(1.17) 



Proof. We only prove (i). For (ii), the proof is similar. 

Necessity: If the solution x{t) extends its existence to tg + S for a certain 
small 5 > 0, by virtue of Lemma 1.3.1 (or Remark 1.3.1), the trajectory of x{t) 
has at most two sub-trajectories: (ia) one traverses Sp at the intersecting point 
X/ 3 , and (ib) one returns to S-^ just after the instant tg. Choosing S sufficiently 
small, we have the following expansion of x{t) around tgi for (ia). 



x{t) = ^ 



+ Er =0 + ^oc){t - + 0{t - 

Vi e [is - (5, ig), 

+ Er=o + 0(i - ig)"'2+^, 

Vi € (ig, ig + (5], 

and for (ib), 

nil -j 

^(i) + + to«)(i - ig)*+i + 0(i - ig)””+2^ 

Vt G [tg — S, tg S], 



where nn and ni 2 are non-negative integers such that 

cA'^~^^Xjs -h cA^bua = 0, i = 0, 1 , . . . , nu — 1, 

^^nii+l^^ _j_ cA'^^^bUa / 0 , 

cA1~^^Xi3 -h cAlbufs = 0 , j = 0 , 1 , . . . , ni 2 - 1 , 

^ cA^^'^bufs / 0 . 

From the Cayley-Hamilton Theorem, for any integer k > n, A^ can be ex- 
pressed as a linear combination of /, A, . . . , A^~^. Hence, nu and ni 2 must be 
in the set Af. Otherwise, cA^+^X /3 -h cA^bu = 0 (n G ZY) for alH G jV* will lead to 
cA^~^^Xf 3 -h cA^bu = 0 for all non-negative integer i, and thus cx{t) — 0 for all 
t ^ [tg — S, tg -h (5]. This contradicts the claim that x{t) has no sliding motion 
for t e [tg — 6, -h <5]. Now, since 
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for (ia), { 

for (ib), 
we get 

for (ia), < 
for (ib), c 



exp = p, 

cx{t) < p, yt e [ts - 6, ts), , 

[ cx{t) > p, e {ts, ts + S] 

exp = P, 

ex{t) < P, yt e [ts -d, ts + (5], t ^ ts, 

^ (nii + l)! ^'''' (^^/3 + bUa){t - + eO{t - < 0, 



Vt G [ts - S, ts), 

+ bup){t - + l cO(t - ^5)^12+2 ^ 

yt G {ts, ts + ^], 

{Axp + bua){t - + eO{t - ^ 

G [^5 — (^, tg -h (j], t ^ ts- 



"(ni2+l)! 

1 



(nil + 1)! 



By considering the process t ts, we establish that, for (ia). 



3 nii,ni 2 G Af, s.t., 



eA^~^'^xp + eA^hup = 0, z = 0, 1, . . . , ni2 - 1, 

cA^^^~^^xp -f eA^^'^bup > 0, 

\ eA^~^^xp eA^bua =0, j = 0, 1, . . . ,nn — 1, 



^^nii + l^^ _j_ cA^^^bUa 



> 0, if nil is even. 



[ eA'^^^~^^xp -h eA'^^^bua < 0, if nn is odd. 



and for (ib). 



3 an odd nn G Af, s.t., 



eA^~^^xp -h eA^buoi === 0, i == 0, 1, . . . , nn — 1, 

+ cA^^^bUa < 0. 



Combining the above with the information on x{t) around the time tp yields 
that, for (ia). 



3 ni 2 G Af, s.t., 



eA^~^^xp 4- eA^bup = 0, i = 0, 1, . . . , ni 2 - 1, 

c^ni2+i^^ -h eA^^^bup > 0, 



and for (ib). 



3 an odd nn G Af, s.t.. 



eA^~^'^xp -f eA^bua = 0, i = 0, 1, . . . , nn — 1, 

+ _j_ cA^^^bUa < 0 . 
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This proves the necessity. 

Sufficiency: Follows from reversing the proof of necessity. This completes 
the proof of the theorem. 

Remark (1.14) (resp. (1.16)) implies that there is at least one extended 

x{t) trajectory just after the instant tg, which traverses Sp (resp. <Sa) at the 
intersecting point (resp. X/3); (1.15) (resp. (1.17)) implies that there is at 
least one extended x{t) trajectory just after the time tg, which returns to S -/3 
(resp. <S+a). If and only if both (1.14) and (1.15) (resp. (1.16) and (1.17)) hold, 
there are two sub-trajectories of x(t) just after the instant tg. 

In Example 1.4.1, although the trajectory of x{t) starting from any initial 
condition xq will intersect Sp or 5^, it can be verified that at the intersecting 
point, neither (1.14) nor (1.15) (or, neither (1.16) nor (1.17)) is satisfied. Thus, 
after the first intersecting, the trajectory cannot evolve. In Example 1.4.2, at 
the intersecting point xi, we check that both (1.14) and (1.15) hold and thus 
there are two sub-trajectories of x{t) just after the instant ti; at the intersecting 
point X 2 , we check that (1.14) holds but (1.15) does not hold and thus there is 
only one trajectory of x{t) just after the instant ^2, which traverses 5^. 

The following is a direct corollary of Theorem 1.4.1. 

Corollary 1.4.1. Under the condition of Theorem if the trajectory of 

x{t) can evolve just after tg and y{tg-) ^ 0, then the solution x{t) is unique 
for t E [tg, tg 5] for some (5 > 0, and its trajectory traverses (or Sa) at 
time tg > 0. 

Proof. Follows directly from Theorem 1.4.1. 

It is seen from Corollary 1.4.1 that the possible sub-trajectory only occurs 
at instant t, which corresponds to an intersecting point and makes y{t-) = 0. 

From Theorem 1.4.1, for any initial condition xq G (without loss of 
generality, let u(0) = U/3 here), let the trajectory of x{t) firstly intersects Sa 
at the intersecting point xu at the intersecting instant tu. The trajectory of 
x{t) can evolve just after the instant if and only if Theorem 1.4.1 (ii) holds, 
replacing Xa by xn. Evolving at xn, the trajectory of x{t) may (if (1.16) holds) 
intersect Sp at intersecting point X21, or (if (1.17) holds) intersect Sa again at 
X12. Using Theorem 1.4.1 again, the trajectory of x{t) (perhaps a sub-trajectory 
of x{t) right now) exists just after reaching X12 if and only if Theorem 1.4.1 
(ii) holds, replacing Xa by X12. If (1-17) still holds, repeat the process until 
such sub-trajectory of x{t) traverses (if so) Sa at xik^ (fci > 2) with the relay 
switching to Ua- After leaving the point xik ^ , it may intersect Sp at intersecting 
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point X 22 > Now, use Theorem 1.4.1 with respect to each intersecting point in 
5/3, and continue the process. Note that the sub-trajectories of x(t) starting 
from any xq are at most countably many. For such an initial point xq^ let 

Xa •= {^11, • • • 5^1A;i5^3l5 • • • • -j? (1-lS) 

<T/3 . — {X 21 5 • • • 5 ^2k2 ? ^41 j • • • 5 ^4k4 5 • • -Ij 

which are the sets of all intersecting points on 5^ and 5^, respectively. Then, 
we have the following result. 

Corollary 1.4.2. Consider system Ur with r = 0. Then any trajectory of x{t) 
starting from xq exists for allt>Q if and only if both of the following hold: 

(i) For any xp G A} 3 , Theorem 1.4-1 (i) holds. 

(a) For any Xa ^ Theorem 1.4-1 (ii) holds. 



Proof. Necessity: Obvious from Theorem 1.4.1. 

Sufficiency: Using Theorem 1.4.1 repeatedly shows that the trajectory of 
x{t) (including its sub-trajectories) can evolve further after each intersection 
of or Let the trajectory of x{t) traverse and A }3 at xi, X 3 , . . . G 
and X 2 ,X 4 , . . . G X^^ respectively, and the time for it to go from xi to be 
ti. If the number of Xi is finite, then x{t) exists for all ^ > 0, completing the 
proof. If the number of xi is infinite, to prove that x{t) exists for alH > 0, it 
sufficient to show that 
k 

lim ti — > 00 . (1.20) 

k —^00 

i=l 

This is done in the following. For simplicity, we will use the following notation: 



ptl2 pt22 ptk2 

/ + / +...+ / f{s)ds 

1 1\\ lt21 Itkl 

ptl2 pt22 

•= / f{s)ds + / f{s)ds + . . . + 

Jtll 'ft21 




Suppose (1.20) is not true. We show this causes a contradiction. Let 



tf :— t{. 

i=l 

Since ti > 0, Vz = 1,2,..., it holds that 0 as i 00 . For A: = 1, 2, . . ., we 
have 



pt2k-l 

X2k = e^*^'‘-^X2k-i + / e^^*^'‘-^~^'>buads, 

Jo 

rt>2k 



X2k+i = e^*^’’X2k + 



f 



oM^2k- 
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So, 



X2k 



rt2k-i 

- X 2 k -1 = (e^* 2 fc-i _ I)x 2 k -1 + / e^^*^'‘-^~^^buads, 

Jo 

Pt2k 

X 2 k +1 - X 2 k = - I)x 2 k + / 

Jo 

Up to here, since it is not clear whether or not X 2 k and/or X 2 k-i is bounded, 
we cannot use a similar deduction to the proof of Lemma 1.3.2 to show a 
contradiction. However, using the fact 

cx2k-i=Oi, cx2k=P, VA: = 1,2,... 

we obtain for all A; = 1, 2, . . . that 

f c(e^*2fc-i _ I)x2k-\ -+■ 

0 < ^ - a = < 

|^c(e^^2fc _ I)x2k + ce^^^^'‘~^^bujgds. 

This shows that it must hold that 



||xi|] -^00 as i oo. 

On the other hand, using f{t — s)ds = f{s)ds, we have 

rti 

X2 = e^^^xi + / e^^buads, 

Jo 



^^ 2+^1 pt2 

xs = H- / e^^buads -I- / e^^^bupds, 

J t2 •'0 



X4 



X^ 



/ 








^3+^2 


+ 








a:i + ( 


t4“t^3+^2 


H- 


/ 


^t4+t3+^2 






J ^4+^3 


+ 



rts-^t2 



J e^^^buadsj 

/ 

Jo 






and generally, we obtain for fc = 1, 2, . 
X2k = e 






X2k+i = 



=1 **a:i + I / + H h / e^^buads ) 

Jo J 

0 V^2fc — 1 . V^2fc — 1 . \^2k—l . \ 

rZ^i-2 /*2^i=4 rl^i=2k-2^' . \ 

+ / +•••+/ e ^buffds J , 

JyT=;^u Jt2,-, J 

i=i *'xi +\ + + ■■ ■ + 

VYlt^u JyILu 



V^2fc M 

r2^i=2fc-i 



e^^buocds 
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Since 

as j — )► oo, 

then || is bounded by some scalar M > 0 for all j = 1, 2, — Thus, 



Ik2fc|| < + f ||e^*6ua||ds 4- [ 

Jo Jo 

< Mllxill + r'(||e^*fe.|| + \\e^^bu 0 \\)ds, 

Jo 



E lk — 
i = l 



\\e^^hu(3\\ds 



and similarly 



lk2ft+i||<M||xi||+ f\\\e^^ba^W 
Jo 

So, \\xk\\ is bounded for all fc = 1,2, . 
(1.20) is true. 



+ We'^^bu^lDds. 

. .. This shows a contradiction. Hence 



It should be pointed out that in the above proof, it is not clear a priori if 
limjb_>oo Yli=i is sufHciently large and A is Hurwitz. If this is true (or, it is 
known a priori that x{t) exists for all t > 0), then a minimum time duration 
tmin > 0 between any two consecutive switching instants can be computed, 
and thus (1.20) is guaranteed. 



Remark 1.4’2. From the proof of Corollary 1.4.1, we see that there are no fast 
switches^ for systems of the form (1.1)-(1.3). For the case a = yS = 0, fast 
switches may occur. See Johansson et al. (1999), which provides a necessary 
and sufBcient condition for the existence of fast switches. 



The following is another corollary to Theorem 1.4.1, with a strong con- 
straint. Denote 

:z:z cA^ + cbu^ < 0}, (1.21) 

Sp := : cA^ + cbu^ < 0}. (1.22) 

Corollary 1.4.3. Consider system Ur r = 0. Then each trajectory of 
x{t) starting from Xo G R^ exists for all t > 0 if both of the following hold: 

(i) For any xp G Sp^ Theorem 1.4-1 (i) holds. 

(a) For any x^ G Sa, Theorem 1.4-1 (ii) holds. 

Proof. For any xo G R^, it is obvious that 

A', C Ap C Sp. (1.23) 

Hence the result follows immediately from Corollary 1.4.2. 



^ Fast switches mean that the relay switches an infinite number of times during a 
finite time interval. 




2. Existence of Limit Cycles 



The preceding chapter studies the existence of solutions to system Er. In this 
chapter, we always assume this property with a default, i.e., a solution always 
exists for alH > 0 for any initial condition xq G . This chapter will consider 
the systems of the same form as in Chapter 1 and study the problem on the 
(existence of limit cycles. 

2.1 Introduction 

One of the important aspects of relay feedback systems, as well as many other 
non-linear systems, is that limit cycles may occur in the trajectories. This 
property is very useful in modern control applications such as automatic tuning 
of controllers and frequency response estimation and identification (Astrom 
and Hagglund, 1995; Atherton, 1993; Wang et aL, 19996; Wang et a/., 1999c). 
Such practical applications motivate the intensive investigation of limit cycle 
behaviours. The study consists in establishing their existence, determining their 
frequency and form, investigating their stability and so on. However, most 
analysis work has been based on the assumption that a limit cycle does exist, 
due to the difficulty of determining if this is really the case. Many classical 
results based on the describing function method are surveyed in Cook (1986) 
and Tsypkin (1984). The describing function method gives an approximate 
analysis of limit cycle behaviours for SISO systems. An exact method was 
reported recently in Astrom (1995). The formula therein with a closed form is 
indeed a necessary condition for the existence of limit cycles with two switches 
per period. This type of periodic orbit is revisited and investigated further 
in Varigonda and Georgious (2001) for RFSs without time delay. For MIMO 
systems also, necessary conditions can be found in the literature. Loh (1994) 
studied limit cycle periods and characteristics by extending Tsypkin’s method. 
The Z-transform technique is exploited in Palmor et al (1992) and Palmor et 
al. (19956) to determine limit cycle periods, which extends the idea of adopting 
the Z-transform for SISO systems (Astrom and Hagglund, 1984a). 
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The existence problem is by no means the key important step in the investi- 
gation of limit cycle behaviours for a relay feedback system. In this chapter, we 
consider a relay feedback system of the same form as in the preceding chapter 
and study this problem through a state-space method. Section 2.2 presents a 
sufficient condition mainly based on Brouwer’s fixed-point theorem. In Section 
2.3, the existence problem is studied through the set of traversing points of a 
single system trajectory. Section 2.4 gives computation formulas for possible 
limit cycle location, which is naturally a necessary condition for the existence 
of a certain type of limit cycle. 

2.2 Sufficient Condition 

In this section, we consider system Ur with additional constraints and seek 
sufficient conditions for the existence of limit cycles. 

2.2.1 Supporting Lemmas 

A set K is said to be convex^ if for any si , 52 G AT, we have Asi-f(l— A)s 2 G K for 
all A E [0, 1]. A subset of is compact if and only if it is closed and bounded. 
For our development, we need the following fixed-point theorem (Kuttler, 1998). 

Lemma 2.2.1. (Brouwer’s fixed-point theorem). Let K he a non-empty com- 
pact convex subset of and let g : K K be continuous. Then, g has a 
fixed point. 

We now establish some useful lemmas, from which we can derive sufficient 
conditions for the existence of limit cycles for system Ur in the next subsection. 
Let G{s) = c{sl — A)~^b. Then, we have G(0) = —cA~^b if A is invertible. 

For system if A is Hurwitz and G(0)wa > l3 > a > G(0)u^, then 
the trajectory of ^{t) starting from any initial condition ^(0) will intersect 
either Sa or in a finite time. We show this by contradiction. Suppose that 
the trajectory of ^{t) intersects neither 5+ nor S- in finite time. Then the 
trajectory of ^{t) is governed by 

^{t) = e^‘^(0) + t e^^*-^^buodz 
Jo 

= + (e^‘ - I)A~Huo 

where uq €.U and U is given as in 1.4. Since -> 0 as f oo (because A is 
Hurwitz), we see that 




2.2 Sufficient Condition 



23 



c^{t) — )> —cA~^buo as ^ 00 . 

Thus, for some T > r > 0, 

c^{t) > ^, t > T, for uo = 
c^(^) < a, t > T, for uq = '^/3? 

which is a contradiction to the relay feedback law (1.2). So, a switch must occur 
at some instant t <T. This implies that the trajectory of ^{t) intersects either 
5-f or S- in finite time. 

To ensure the occurrence of consecutive switchings, we need the following 
assumption. 

Assumption 2.1 A is Hurwitz and G{0)ua > j3 > a> G(0)u^. 

Note that neither A being Hurwitz nor G[G)Ua > 0 > a > G{0)up is a 
necessary condition for the occurrence of switchings. However, with our default 
that a solution with any initial condition xq G always exists for alH > 0, 
Assumption 2.1 ensures that each system trajectory makes the relay switch 
consecutively. 

Here, we only study a class of systems satisfying the condition that for each 
system trajectory the time duration between any two consecutive switchings is 
longer than r. Obviously, this is always true for r = 0. For r > 0, early switches 
may occur in some systems. When this happens, the complicated system tra- 
jectory characteristics makes system analysis very difficult. So, to avoid early 
switches we assume the following. 

Assumption 2.2 For r > 0, any trajectory of system Ur has time duration 
between any two consecutive switchings longer than r. 

See Chapter 4 later (indeed refer to Remark 4.3.2 for the details) for a class 
of systems which satisfies Assumption 2.2. In many processes, the system will 
exhibit monotonous behaviours, that is, ys{t) > 0 where ys{t) is the output 
step response. In this case. Assumption 2.2 is also satisfied. 

The following lemma provides an invariant contraction region i?, which any 
trajectory of system Ur will eventually enter and remain in. 

Lemma 2.2.2. Consider system Ur with A Hurwitz. Let P > 0 be the unique 
solution to the Lyapunov equation 

A^P + PA^-I (2.1) 



and let 
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,ax = max{|ua|, 
w= max IIPs^ll, 

12 = {C € 1" : ||P5^1| < w}. 



Then, ft is an invariant contraction region for system Ur 



( 2 . 2 ) 



Proof. We prove by contradiction. Suppose for some solution ^{t), it holds that 
^(^i) G i? and ^(^ 3 ) ^ ft with ts > ti. By continuity, there exists a time 
t 2 G [^ 1 , ^ 3 ) such that 

^^(t 2 )P^(* 2 ) = 'it e {t2, ts], (2.3) 

which implies for t e (^ 2 , ^ 3 ] that 

U{t)\\ > 2 w max \\Pb\\. (2.4) 

Now, letting V (x) = x^Px, it follows that 

= x'^iA'^P + PA)x + 2x'^Pbu 
at 

= -||a;||^ + 2x'^Pbu. 

Noticing that |u| < Umax^ we obtain 

< -\\x\\‘^ + 2Uma.\\Pb\\\\x\\. 
at 

It is seen that for \\x\\ > 2umax\\Pb\\^ we have V{x) < 0. So, from (2.4), for 
t ^ {h, ts], it holds that < 0, giving 

e(t)pm = vm) 

V(^{z))dz 

< v{at2)) 

which contradicts (2.3). This completes the proof. 



-na^2)) + 1 



Remark 2.2.1. There are several ways to specify an invariant region such that 
all trajectories of system Ur will eventually enter and remain in it. Hsu (1990) 
computed an invariant region for a class of relay feedback systems with the 
control containing an integrator. It should be noted that there may not exist 
a fixed time T such that all trajectories will be bounded by a fixed bound for 
t >T. Check the simple first-order example: 

x{t) — —x{t) -h u{t) 
y{t) = x{t) 
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with u{t) = —1 for y{t) > 0, and u{t) = 1 for y{t) < 0. Then ^ — 1 is 

Hurwitz. But, for any large L > 0 and T > 0 there exists an initial state Xq > 0 
such that x(T) = e“^(xo -h 1) — 1 > T. So, no such a fixed T is available. 

In the ultimate contraction region i7, a scalar ojo > 0 can be found such 
that 

||^||<wo, (2.5) 

In the sequel, we let 

if? Qi^ . — f? ^ol j 

( 2 . 6 ) 

Also, define respectively, for ^ and the following sets. 

= lie - ^( 0)11 <e, ^ 06 %, £> 0 } 

= {ee%: e = e(0)+A eoe%, ||/i||<e, e>0}, (2.7) 

£(e,eo,a) = {e e : 11^ - e(0)|| <£,^06 Qa, £ > 0} 

= G i = ^( 0 ) + ^, ^0 ^ ll^ll < ^5 e > 0 } . ( 2 . 8 ) 

The next lemma shows the relationship between two trajectories of system Er 
at the switching instants, which plays an important role in achieving the main 
result. 

Lemma 2.2.3. Suppose Assumptions 2.1 and 2.2 hold. If a trajectory of sys- 
tem Er evolves from ^{to) G and traverses fia ^{to + h), then there 
is a scalar e > 0 such that any trajectory evolving from the local region 
>C(€?^(^o) 5 /^) C i ?/3 will intersect o,t some time to -\- h d, where 6 sat- 
isfies 

|5|*+i < Mpll (2.9) 

for some scalars M > 0 and k € Af, where the set Af is as in 1.13. 

In the proof of Lemma 2.2.3, the following result is needed. 

Lemma 2.2.4. Consider system Er with r > 0. Suppose a trajectory intersects 
the switching planes Sa and S/3 at G Sa and x^ G respectively. Then, 
Xa and xp are traversing points if and only if there exist two even integers 
e Af such that the following hold: 



cA^'^^Xa + cA^bu0 = 0, i = 0, 1, . . . , — 1, 




cA^“~^^Xa + cA'^‘^hu0 < 0, 


(2.10) 


cA^'^^x^ + cA^bua = 0, j = 0, 1, . . . , — 1, 




+ cA^^bua > 0. 


(2.11) 




26 



2. Existence of Limit Cycles 



Proof. We consider the proof of (2.11). For (2.10), the proof is similar. 

Necessity: Suppose that the trajectory of x{t) traverses at Xjs G 5^. Let 
the instant t = correspond to x(^^) == x^. For a sufficiently small 5 > 0, we 
have the following expansion of x(t) in ^ G — 5, tfs 5\: 

^/3 

x{t) = x{t/ 3 ) + ^ A\Axp + hua){t - + 0 {t - 

i=o 

where > 0 is an integer such that 

cA^~^^Xi3 + cA^bUa = 0 , 2 = 0 , 1 , . . . , — 1 , 

+ cA^^bUa / 0 . 

From the Cayley-Hamilton Theorem, for any integer k > n, A^ can be ex- 
pressed as a linear combination of 7, ^, . . . , Hence, G N. (Other- 

wise, cA^~^^x^ -h cA^bua = 0 for all i G A/^ will lead to cx{t) = ^ for all 
^ G [^0 — ^0 + This is a contradiction of X /3 being a traversing point.) 

Now, since 

cx{t)>p, te{t 0 , t (3 + S], 
cx{t)< 0 , te[ti 3 - 6 , t^), 
we have that for t ^ {tjs, + J] 

-—^cA^^{Ax 0 + bua){t - t 0 r^+^ + cO(t - > 0 , 

{n0 + 1 )! 

and for t e[t 0 — 6 , t^) 

— 1 — (Ax 0 + buc,){t - + cO(t - t 0 r^+^ < 0 . 

[n^ + 1 )! 

Considering a process t we see from the last two inequalities that the 

non-negative integer must be even and 

cA^^-^'^x^+cA^f^bua> 0 . 

This proves the necessity. 

Sufficiency: Sufficiency can be seen by just reversing the proof of necessity. 
This completes the proof of the lemma. 

Proof of Lemma 2.2.3. We first assume that r > 0. Without loss of generality, 
we show proof with respect to the set £(e,^o,y5) only- As for the case with 
respect to the set £(e, ^OjOf), the proof is similar. 

Let the trajectory of ^{t) traverse i7c^ at ^(^o Ah). By virtue of Lemma 
2.2.4, there exists an integer k e J\f such that 
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+ /i) + cA^bu0 ==0, i = 0, 1, . . . , A: - 1, 

+ h)+ cA'^bup < 0 . ( 2 . 12 ) 

Define 



f{S) = - I){A-^hu0 + C(io + h)). 

Taking into account the fact that 

+ f^) + < 0> 

by defining /(O) := lim^j^o f{^) < 0? there is a scalar r satisfying 0 < r < h-r 
such that f{S) < 0 is continuous on J C [— r, r]. Define 



M = max 

<5g[— r,r] 



\\ce^(h+s)\\ 

l/(<^)l 



> 0 . 



In view of the Assumptions, the trajectory of rj{t) starting from ^(to) + ^ € 
C{e, ^ 0 , P) will intersect Qa at some time to + h + 6, and it holds that h + 6 > t. 
Thus, we have 



^{to + h)= e^^^ito) + - e^(^-^^)A-^huc, + - I)A~^ba0, 

c^{to + h) = a, 

T]{to + h + 6) = + ^) + - e^^’^+^-^^)A~Hua 

^^A(h+S-r) _ I)A~^bU0, 



c7](to h -{- — Oi. 



After some simple manipulations, we arrive at 

0 A + c{e^^ - I){A~^bu(i + C(to + h)). (2.13) 

Next we show that if ||Z\|| is small enough, then |J| will be less than r. We 
prove this by contradiction. Suppose that ||Z\|| is very small and the trajectory 
of T]{t) will not intersect Qa for all ^ G [to h — h r\. Then, for 

t e [h - r, /i + r], 

7/(^0 + t) = + Z\) + - e^^^~'"^)A~'^bua + - I)A~'^bu(3, 

CT]{to + t) > a. 



Since 



Tj{to h S) — ^{to + /i) — > 0 as 5 ^ 0 and \\Al\\ 0, (2.14) 

cA\A^{to + h) + bup)<0, (2.15) 

there exist ei > 0 and vq satisfying 0 < ro < r such that for all \5\ < Vq and 
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cA.^ (^A.f](to + + J) + <C 0 . 

Expanding rj{t) at time to+h and taking into account (2.12) and c^{to-\-h) = a, 
yields 

T]{to h S) = 'ni^o + /i) + ^ ^ + /i) + bup) 

i=i *• 

+ j h-\- 6sS) H- &U/ 3 ) 

k • k • 

= e(to + /i) + E + h) + bu0) + ^ 

2=1 2=0 

^A;+l 

(fc + ^(5(5) + &U/ 3 ), 

giving 

^vi^o A h -\- 6 ) = O' + ^ ^ — cA^ jA + t--— (^77(^0 + + bup) 

2=0 * V y * 

for some 0 < ^<5 < 1. Letting S = vq > 0 (and thus < ro), and letting 
||Z\|| -> 0 , it follows that there exists a scalar €2 satisfying 0 < €2 < ci such 
that for all ||zi|| < C 2 

crj{to -\- h -h Vq) < a. 

This contradicts crj{to 1) > a for alH G [h — r^h r]. From the above, we 
also see that if ||Z\|| < C 2 , then \6\ <ro<r. 

Now, from (2.13), we have 

0 = + 5*^+V((5) 



and thus 
(5*+i = 



ce^h+s) 

'~WT 



A V||Zi||<€2, 



which gives 

\5\>^+^ < M\\A\\, V||AI<e2. 



(2.16) 



This proves the lemma for r > 0. 

For the case r = 0, by virtue of Theorem 1.4.1 (as stated in Remark 1.4.1), 
the lemma can be proved similarly by using (1.14) and (1.16). This completes 
the proof. □ 
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2.2.2 Existence of Limit Cycles 

This subsection presents a sufficient condition for the existence of limit cycles. 
The result needs the following assumption. 

Assumption 2.3 For system 17^-, if a trajectory intersects Qql or then it 
traverses the switching plane Sa or S^. 

It is known from Chapter 1 that there is no sliding motion after a trajectory 
intersects or Assumption 2.3 indeed ensures the uniqueness of system 
solutions in the region O and the vector fields point in the ‘right’ direction on 
both sides of the switching planes. Let us check a simple class of systems for 
the validity of Assumption 2.3. 

Example 2.2.1. Consider system Er with r > 0. Suppose that there exists an 
invertible matrix Q such that 

Q-^AQ = , cQ = [1 0 . . . 0] (2.17) 

^21 -^22 

where An G M. For this system, if 

AiiP + chua > 0 , 

Ana + cbup < 0 , 

it is easy to check that the conditions in Lemma 2.2.4 hold for Ua = = 0, 

i.e., 

cAXj3 + cbUa > 0, VX /3 G <S/ 3 , 
cAXa + cbUj 3 > 0, 'iXa C Sa- 

It is seen that this example satisfies a very strong constraint in the sense that the 
traversing requirement in Assumption 2.3 holds for all Xa C Sa and x^ ^ Sp. 

With the aid of the lemmas presented in the preceding subsection, we are 
now in a position to give the existence result. 

Theorem 2.2.1. Suppose Assumptions 2.1, 2.2 and 2.3 hold. Then system Er 
has a limit cycle. 

Proof. By Assumption 2.1, the trajectory of x{t) starting from x(0) G f? will 
intersect, without loss of generality, f}p. Suppose the intersecting point is x{ti) 
(at time ti). By Assumptions 2.2 and 2.3, the trajectory of x{t) will traverse 
and intersect Qa at some point x{t 2 ) (at time t 2 > h A r), and then will 
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leave and traverse again at some point (at time > t 2 -\-r). Define 
the mapping (i.e., the Poincare map) <? : i?/? as 

^{x{h)) = x{tz). (2.18) 

Then ^ maps into itself. In order to adopt Lemma 2.2.1, we need to verify 
the following. 

(i) ^ is continuous in i?^. Indeed, without loss of generality, consider the 
three points x{ti)^ i = 1,2,3. By virtue of the proof of Lemma 2.2.3, for any 
as > 0, there exists «2 > 0 such that any trajectory of rj{t) evolving from 
t]{2) = x{t 2 )-\- a G i?a, where ||Z\1| < 0^25 will intersect and traverse and the 
traversing point r/(3) satisfies ||7y(3) — a:(^3)|| < as- For this 0^2 > 0, there exists 
ai > 0 such that any trajectory of evolving from ^(1) = x{ti) + zi G i?/3, 
where ||zi|| < ai, will intersect and traverse Qa, and the traversing point ^(2) 
satisfies ||^(2) — x{t 2 )\\ < «2- This shows that if ||Zi|| < ai, then 

mx{h) + A)~^{x{h))\\<as 

which proves the continuity of the mapping 

(ii) is a non-empty compact convex set. The fact that is non-empty 
is obvious. The compactness of is easily seen from the definition of compact 
set. The convexity is verified as follows: 

^ / c(A^i + (1 - A)^2) = yd => A^i -h (1 - A)^2 G 5/3, 

v^l,^2 G J//3 \ 

[ WPHX^i + (1 - A)6)|| < a; Aa + (1 - A)6 G 12, 

where A G [0, 1]. 

Now, by Lemma 2.2.1, there exists G such that ^{x^) = x^, which 
implies that there exists a solution x* (t) (with x^ as its state) and time 
such that 

^{x^{hl))=x\hl). (2.19) 

After t = h 2 , the trajectory of x*{t) will be the same as from t = /i* to ^ = /i2- 
This shows that the trajectory of x*{t) is a limit cycle with a period — hi. 
This completes the proof. 

Remark 2.2.2. The result of Theorem 2.2.1 is for system Ur with hysteresis. 
For systems with no delay and hysteresis (i.e., r = 0 and a = 0 = 0), fast 
switches may occur, and there are possibly infinite (but countable) numbers of 
switching times during a finite time interval. (See Theorem 1 in Johansson et 
al. (1999).) In the case of this phenomenon, we say that the system trajectory 
has an accumulation point. (See the example in Remark 15 in Lootsma et al. 
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(1999), which is taken from Filippov (1988).) Note that under Assumption 2.3, 
with no accumulation points, the result in Theorem 2.2.1 still holds for system 
Ur with T = 0, a = P = 0, A Hurwitz and G(0)ua > 0 > G{0)up. 



2.3 A Simple Existence Condition 

We have studied in Section 2.2.2 the existence of limit cycles for relay feed- 
back systems of the form Ur - In practice, from the simulations, the trajectories 
of many such systems, whether A is Hurwitz or not, often tend to a certain 
oscillation with the relay switching consecutively. This section studies the ex- 
istence problem through a single system trajectory, and establishes a simple 
condition to determine the existence of limit cycles. The limit cycles are not 
merely confined to be symmetric or to have two switches a period. 

Let a trajectory of system Ur traverse Sa (resp. S/s) at Xa (resp. Xjs), and 
then traverse 5/3 (resp. Sa) at x^ (resp. x^). Define the mapping Ta (resp. Tp) 
as 



Ta : Xa — y xp (resp. : X/3 — > Xa)- (2.20) 

It is seen that such defined Ta and Tjs are one-to-one continuous mappings. 
(Note that when a trajectory intersects the switching plane but does not tra- 
verse it, such an intersecting point is not a traversing point.) If a system tra- 
jectory keeps traversing an alternative switching plane after it traverses each 
switching plane, i.e., in the sequence 5 q,, 5/3, 5^, . • in an infinite way, then the 
trajectory is said to cause regular relay switchings. Our analysis begins with a 
trajectory which meets the following assumption. 

Assumption 2.4 The trajectory of x(t) of system Ur starting from xq causes 
regular relay switchings and the time difference between each two successive 
switchings is longer than r. 

Before the analysis we can arbitrarily choose a point xq G , and check if 
the resulting trajectory meets the assumption. If not, we change the xq until a 
trajectory meeting Assumption 2.4 is found. If no such trajectory exists, theo- 
retically, there does not exist a limit cycle which causes regular relay switchings 
and for which the time difference between each two successive switchings is 
longer than r. 

Suppose now that a trajectory which satisfies Assumption 2.4 is available. 
In more detail, without loss of generality, let cxq > P (and thus u = u^) at the 
starting point. Suppose the trajectory of x{t) traverses Sa for the first time at 
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xia- After a time longer than r, the trajectory traverses S/s for the first time 
at xi^. After another time longer than r, the trajectory traverses Sa for the 
second time at and then, after another time longer than r, it traverses S/3 
for the second time at X2/3. The process continues forever. See Figure 2.1. 




Fig. 2.1. The trajectory of x(t) 

Let 

Tq . — ’ ’ * } 5 (2.21) 

— {xi/3,X2/3, • • • } • (2.22) 

It is obvious that the two sets Fa and Ff^ are at most countable. It is seen that 
Ta{xia) = XifS and T^(xi^) = X2a- If X2a = Xia, then X2P = Ta{x2a) = Xi^. 
This results in xia = x\a and Xijs = xip for alH = 2, 3 , • • • , and thus such a 
trajectory is a limit cycle with two switchings per period after the first switch- 
ing instant. Similarly, if X2p / Xi^, then the trajectory of x{t) is a limit cy- 
cle with two switchings per period after the second switching instant. Now, 
for some natural number > 1, suppose xia,X 2 ar” 5^(AT-i)a differ- 
ent and XNa = XNoa for some 1 < A^o < A'. Then it is easy to verify that 
XNoP,X 2 / 3 r ' ' 5^(iv-i)/3 are different and xn /3 = x^ofs- This implies that the 
trajectory of x{t) evolving from the traversing point XNoa is a limit cycle with 
2{N — No) switchings per period. 

The following is a summary of the above analysis. 

Proposition 2.3.1. Suppose Assumption 2.4 holds. If the set Fa is finite, 
i.e., there exist two natural numbers N and Nq with 1 < A^o < A such that 
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^ia,X2ar ' ' ^^(N-i)a different and XNa — then the trajectory of 

x{t) evolving from the traversing point x^oa Is a limit cycle with 2{N — Nq) 
switchings per period. Moreover, all the traversing points are xia and Xip, 
i = No,...,{N-l). 

In practice, if the given system has at most a finite number of limit cycles, 
the chance of the trajectory starting from the arbitrarily chosen xq to be a 
limit cycle is nearly zero. This is to say that the sets Fa and are not finite 
in general. Our main concern in the following will focus on the case that Fa 
and F^ are infinite (indeed countable). 

Suppose that Fa is infinite. Then is also infinite. If Fa has limit points, 
obviously, these limit points belong to Sa . It will be clear later whether or not 
they are elements of Fa> Let one such limit point be G Then there 
exists a subset 

^ka • — ^k20r> * ’ ’ ? ^kiaj ’ * * } O Fa (2.23) 

such that 

lim Xkia = 6a- (2.24) 

z— >-oo 

Lemma 2.3.1. limi_).oo ^ki(3 exists, and if denoted by 6/3; then Ta{^ia) = 6/3* 

Proof. Since Ta is continuous, then 

lim Xki(3 = lim TaiXk^a) = Ta{lim Xk^a) = Taisia) = 6^- 
>oo >oo z— >-oo 

This proves the lemma. 

Lemma 2.3.1 says that if a system trajectory traverses Sa at 6a, then this 
trajectory must intersect and traverse Sp at 6/3- Moreover, the time taken by 
this trajectory in going from 6a to 6/3 is longer than r. 

Remark 2.3.1. The boundedness of x{t) guarantees the existence of limit points 
of as a bounded infinite set has a convergent sequence. 

We now give the result for the case that Fa has a unique limit point. 

Theorem 2.3.1. Suppose that Assumption 2.4 holds and Fa is infinite. If Fa 
has a unique limit point, say 6a? or, if Fjs has a unique limit point, say 6/3? 
then there is a limit cycle with two switchings per period, which traverses Sa 
(resp. Sa) at (resp. ^ 10 ). 
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Proof. We first assume that Pa has a unique limit point ^la- By Lemma 2.3.1, 
Ta(^ia) (set to be ^1/3) is a limit point of Pj^. Following the proof of Lemma 
2.3.1, is defined, which is a limit point of Pa- So, we have Tp{^ii3) = 

due to the uniqueness of limit points of Pa - This shows that the trajectory which 
traverses Sa (resp. S 13 ) at (resp. ^1/3) is a limit cycle with two switchings 
per period. 

Now, suppose ^2(3 is another limit point of Pjs. Then, we get T^{^2i3) — 
since is the unique limit point of Pa- Thus, ^2/3 is the traversing point of 
the limit cycle, implying that ^2/3 = ^i/3- 

Similarly, if we assume that P^ has a unique limit point, the rest of the 
proof follows a similar line. This completes the proof. 

In Theorem 2.3.1, it is seen that ^ Pa and ^ P^. Otherwise, the set 
Pa would be finite which is a contradiction. The result in Theorem 2.3.1 can 
be extended to the case that Pa has multiple limit points. 

Theorem 2.3.2. Suppose that Assumption 2.4 holds and Pa is infinite. Let f 
be a natural number. If Pa has f limit points, say ^ic^, • • • or if P^ has 

f limit points, say ^1^, • • • ,^//3; then there is at least one limit cycle with 2/i 
switchings per period where fi is a natural number satisfying 1 < /i < /. 

Proof. We first assume that Pa has / limit points, say ^la,*** ^^fa- From 
Lemma 2.3.1, for some ^rma C 5^/a}? we have Tai^mia) is a limit 

point of P^. Then there is a trajectory, say a:*, which traverses Sa at ^rma 
and spends a time longer than r to reach the traversing point Tai^mia) C Sp. 
After that, each time traverses Sa or Sp, the traversing point is a limit 
point of Pa or Pp. Since Pa has a finite number of limit points. Proposition 
2.3.1 concludes that is a limit cycle with 2/i switchings per period where 
fi is some natural number satisfying 1 < /i < /• Moreover, letting ^rma ^ 
^ = 1^2, •• • ,/i, be the different fi traversing points of x* on 
Sa, we see that Ta{^rma), i = 1, 2, • • • , /i, are the different fi traversing points 
of X* on 5/3. 

Let ^p,a € Uia,-*- and ^p^a / ^rma, i = 1,2 ,--- ,/i. A similar 

deduction yields that, with as a traversing point, another limit cycle, say 
X2, exists with 2/2 switchings per period where /2 is some natural number 
satisfying 1 < /2 < / ~ /i • It is obvious that the 2/2 traversing points of X2 
are different from those of 

Repeating the above deduction, we see that there are a finite number of 
limit cycles which contain the 2/ limit points 

^ia ^ ^a, and Tai^^ia^ ^ ^j 3 , ^ I5 2, * • • , f 
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as the traversing points. 

Now suppose that 1)3 has another limit point, say Then, it is easy to 

show that belongs to one of the above limit cycles, and hence = 

Taisia) for some i = 1,2,-- - ,/. This proves that Fp has only / limit points. 

Assume next that F^ has / limit points. A similar proof shows that Fa also 
has / limit points, and there exists at least one limit cycle. This completes the 
proof. 

It is seen from the proof of Theorem 2.3.2 that all the 2/ limit points are 
the traversing points of certain limit cycles. So, we have ^ia ^ Fa and ^ Ff^ 
for alH = 1, 2, • • • , /. 

So far, we have given existence results about limit cycles for system Er with 
r > 0. Systems of the form with no delays (i.e., r = 0) can be analyzed 
similarly. However, we need a slight modification. This is because, unlike the 
case r > 0, the trajectories of system Er with r = 0 may not be smooth 
anymore at the intersecting points when they intersect Sa (resp. S^). In the 
following, we will use Eq to denote the system Er with r = 0. Arbitrarily 
choose a point xq G Assumption 2.4 is reduced as below. 

Assumption 2.5 The trajectory of x(^) of system Eq starting from xq causes 
regular relay switchings. 

Similar to (2.21) and (2.22), let Fa and F^ be the two sets of traversing 
points on Sa and 5^, respectively, which are at most countable. For Fa and F^ 
finite, a simple result analogous to Proposition 2.3.1 is as follows. 

Proposition 2.3.2. Consider system Eq and assume Assumption 2.5 holds. 
If the set Fa is finite, i.e., there exist two natural numbers N and Nq with 
1 < No < N such that x\a,X2ar " different and x^a = XNoa, 

then the trajectory evolving from the traversing point XNoa is a limit cycle with 
2{N — No) switchings per period. Moreover, all the traversing points are Xia 
and Xiis, i = A^q, . . . , (iV - 1). 

For Fa and Ff^ infinite, we need the following assumption. Denote y{t-) the 
left derivative of y(t) at time t, i.e., y{t-) = lime>o,€-^o y{t — ^)- 

Assumption 2.6 There is a small scalar cq > 0 such that the trajectory of 
x{t) starting from xq satisfies \y{t-)\ > eo at all traversing points. 

We have the following result which is analogous to Theorem 2.3.2. 
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Proposition 2.3.3. Consider Eq and assume Assumptions 2.5 and 2.6 hold. 
Let Fa he infinite (so Fp is infinite). If F^ has a finite number of limit points, or 
if Fjs has a finite number of limit points (say f), then there is at least one limit 
cycle with 2/i switchings per period where f\ is a natural number satisfying 
1 < /i < /. Moreover, the f\ traversing points of the limit cycle on Sa belong 
to the set of limit points of Fa . 

Proof. The proof is similar to that of Theorem 2.3.2, and thus is omitted. 

2.4 Limit Cycle Location 

If there is a limit cycle for system Er, say x*, then its trajectory is governed by 
a periodic solution to the system. This section gives the formulas for specifying 
the locations of the limit cycle in a closed form. Assume that the trajectory of 
the limit cycle x* makes the relay switch two times per period. (For more than 
two switches per period, more formulas are needed.) Let the traversing points 
be X* G Sa and x*^ C respectively, and the period be (r ha) {r + h/^) 
with ha > 0 and h^ > 0, where r + ha (resp. r + h^) is the time taken for 
the trajectory of x* to move from x* to (resp. from x*^ to a;* ). Then, the 
parameters should satisfy the following conditions: 

x} = + f + f ° 

Jo Jo 

Jo Jo 

ex} = P, 

c< = a. (2.25) 

Obviously, the following should also be satisfied: 

c(e"^^x* + [ e^^^~^^bupds) < Vt G [0, r], 

Jo 

c(e^^x* + f e"^^^~^^bui 3 ds ( e"^^^~^^huads) < /3, G [r, r + ha], 

Jo Jo 

c{e^^xp 4- f e^^^~^^buads) > a, Vt G [0, r], 

Jo 

c{e"^^x'^-h f e"^^^~^^buads ( e^^^~^^bui^ds) > a, G [r, r-\-h^]. 

Jo Jo 

Noting the fact that I—e^^ is invertible (for t ^ 0) if and only if \{A) / j2k7rt~^ 
for any integer fc, we see that if A has no roots in the imaginary axis, (2.25) 
gives 
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nha.-\-T -\-hfi 



e"^^buads 



a = c{I - eMr+hoc+T+hi3)yi ^ J 

f*T-{-ha-\-T-\-h^ ^ php \ 

^bu^ds-\- J e^^bupdsj , 



f 

Jha 






+ I e' 

^a+T -\-h^ 

( fha+r-i-h/3 

J e^^bu0ds 

^r + /la+T + /l/3 pha 

+ / e^^buads + / 

dhd~\'T~\~hp Jo 



e^^buads , 



(2.26) 



where we use the fact that f{t — s)ds = f{s)ds. Once ho, and hjs have 
been computed from (2.26) using a numerical method, x* and x*^ are obtained 
as 



rT -\-hoc-\-T -\-h^ 



(£■ 



^a+T -\-h^ 



e^^buads 



pT-tfict-rT-rri^ pn^ \ 

+ / e^^buj^ds + / e^^buf^ds j , 

Jhct~\~T-\-h^ Jo J 

( pha-]-T + /l^ 

J e^^bu0ds 

rT + Zla+T + Zl^ phoc \ 

+ / e^^buads + / e^^buads ] . 

J hoc~\~T-j-h0 Jo J 



(2.27) 



If a -{-/S = 0, Ua+ui 3 == 0 and the limit cycle x* is symmetric, the expression 
in (2.26) is simpler as only one equation with one variable (i.e., ha or hp 
where ha = h^) is left. As a result, the traversing point x* = — can be 
computed accordingly through (2.27). This is also discussed in Astrom (1995) 
and Varigonda and Georgious (2001). 




3. Local Stability of Limit Cycles 



This chapter is concerned with the local stability of limit cycles for linear 
systems with relay feedback, for the cases where the linear system includes a 
time delay in its dynamics and the relay can possess asymmetric hysteresis. The 
limit cycle considered can be asymmetric, have more than two switchings per 
period, and zero output derivatives at the switching instants. It will be shown 
that if a certain constructed matrix is Schur stable, then the local stability of 
the considered limit cycle is guaranteed. 



3.1 Introduction 

We have studied in the preceding chapters problems concerning the existence of 
solutions and the existence of limit cycles for relay feedback systems. Another 
important analysis topic is the stability of limit cycles of relay feedback systems. 
This includes local stability and global stability of limit cycles. Local stability 
ensures that all nearby trajectories converge to the limit cycle as time tends to 
plus infinity, while global stability means that all trajectories converge to the 
limit cycle as time tends to plus infinity. The phase-plane approach is a classical 
technique employed for the stability analysis of limit cycles (Guckenheimer 
and Holmes, 1983; Tsypkin, 1984). Exact methods have also been reported in 
the literature (Astrom, 1995; Goncalves et al, 2001; Johansson et aL, 1997; 
Johansson et ah, 1999; Lin et ah, 2000). Astrom (1995) gives elegant criteria 
for the local stability of symmetric and asymmetric limit cycles by considering 
the linear approximation of the Poincare map. Johansson et ah (1997) and 
Johansson et ah (1999) focus on the fast switches of relay feedback systems 
and present local stability results for limit cycles with sliding motion. A method 
to compute a local stability bound is presented in Goncalves et ah (1998). It 
gives sufficient conditions for the locally stable region in terms of the existence 
of solutions to linear matrix inequalities. Another discussion of local stability 
is given in Lin et ah (2000). For the global stability of limit cycles, a recent 
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paper (Goncalves et al, 2001) obtains sufficient conditions in terms of a set of 
linear matrix inequalities by finding the so-called surface Lyapunov function of 
Poincare maps. As seen in the stability analysis, a limit cycle is always assumed 
to exist a priori. 

In this chapter we consider the local stability of limit cycles for a time- 
delay relay feedback system with the relay containing asymmetric hysteresis. 
The relay is not required merely to switch twice per period and the assumed 
limit cycle is not confined to be symmetric. Additionally, it is not required that 
the trajectory of the limit cycle be non-tangent with the switching planes at the 
switching instants. From an engineering point of view, time-delay systems are of 
considerable interest (most industrial processes have time delay). Theoretically, 
a non-zero time delay ensures that a system trajectory evolves uniquely at the 
intersecting points. Also, non-zero time delay makes it possible to relax the non- 
tangent condition of the trajectory of the limit cycle at the traversing points. 
This relies on continuity at the intersecting points, and intuitively it is the 
‘overshoot’ effect. Otherwise, if the considered system is delay-free, the non- 
tangent condition of the trajectory of the limit cycle at the traversing points 
has to be assumed, like the case considered in Astrom (1995), Johansson et al. 
(1997) and Lin et al. (2000). Such a condition avoids the occurrence of multiple 
trajectories after a trajectory intersects the switching planes, and makes the 
local stability analysis simpler. We will includes this case for delay- free systems 
in Remark 3.3.3. 

This chapter is organized as follows. In Section 3.2, the considered system 
and problem are formulated. Section 3.3 presents sufficient conditions for the 
local stability of a limit cycle with two switches per period. Section 3.4 extends 
the result to the local stability of limit cycles with more than two switches per 
period. 



3.2 Problem Formulation and Preliminaries 

Consider a single-input single-output plant described by 
x{t) = Ax{t) + bu{t — r) 

y{t) = cx{t) (3.1) 

where x(t) G y{t) G M and u{t — r) G M are the state, output and control 
input, respectively; A, 6, c are constant real matrices or vectors with appropriate 
dimensions; r > 0 denotes the time delay. The plant has relay feedback: 
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u{t) = 



Ufs, if y{t) > /?, or y(t) > a and u{t-) = Uj 3 , 



(3.2) 



Ua, if y{t) < a, or y{t) < p and u{t-) = Ua, 

where a, /? G M with a < P denotes the hysteresis; Ua,u^ eR and Ua ^ Due 
to time delay r > 0, we have to specify the initial function u{i) for i G [— r, 0]. 
For the convenience of our analysis, in this chapter we let 



u{i) = 



U/ 3 , if y{0) > a 



Ua, if 2 /( 0 ) < a. 

We still call (3.1)-(3.3) a relay feedback system and denote it by U. 
As in the preceding chapters, define the switching planes: 



Let 



(3.3) 



li 

(Ti 

II 

S 


(3.4) 


5/3 := e M" : c^ = 13}. 


(3.5) 


S+a := e M" : c^>a}, 


(3.6) 


S-a := {^ € E" : < a} , 


(3.7) 



and let S^p and 


S-p be 


defined similarly. Let ^a ^ Sq 


, ^0 e S0, and 


let 




■= 




G Sa • 


ll^-ea||<e} 








= 




G Sa : 


^ + A, l|/i|| < e] , 






(3.8) 






G Sp : 










- 


{e 


e Sp : 


+ A IIAI <4- 






(3.9) 




(or 




^^)), we say that ^ is within e 


distance of ^a 


(or 


^/s). 



3.3 Local Stability of Limit Cycles 

In the local stability analysis for limit cycles of system we assume that there 
exists a limit cycle x* of the following form. 

Form 3.1. The limit cycle x*, which traverses Sa and Sp at the traversing 
points X* G Sa and x^ e Sp, respectively, makes the relay switch twice per 
period. The limit cycle period is (r + ha) + (r + hp) with ha > 0 and hp > 0, 
where r ha (resp. r + hp) is the time taken for the trajectory of x* to move 
from X* to x*^ (resp. from to x* ). 

For illustration, see Figures 3.1 and 3.2 where x*{t) denotes the system 
solution corresponding to the limit cycle x*. For determining the locations of 
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the limit cycle in Form 3.1, computation formulas have been given in Section 2.4 
of Chapter 2. Numerical methods have to be exploited to specify the parameters 
of traversing points and periods of the limit cycle. 




Fig. 3.1. The trajectories of x*{t) and x{t) starting from xq G IZe 




Fig. 3.2. The trajectories of cx*(t) (solid) and cx(t) (dashed) corresponding to x*{t) 
and x{i)^ respectively 



Without loss of generality, we set to — 0 corresponding to the time instant 
when the trajectory of x* makes the relay switch from Ua to see Figures 
3.1 and 3.2. Define 
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=:{eei?": ||^-xS||<e} 

= ^ = x*o + A, AeR’^, \\A\\<e}. (3.10) 



Since cxq > a, let a scalar ei satisfy 



0 < ei < 



CXn — Q: 



(3.11) 



Then, any trajectory of system U starting from 1Ze^ will satisfy cxq = c{xq + 
A) > a, implying (from (3.3)) that the relay will be u{—r) = Ujs at the starting 
moment. 

To achieve our stability result, we need to establish some lemmas first. As 
in Chapter 1, let 



Ar-{0,l,...,n-l}. (3.12) 

The first lemma specifies two positive integers no,,n /3 G A/*, which will be used 
in the development. 



Lemma 3.3.1. For the limit cycle in Form 3.1, there exist two even integers 



Ufs G Af such that the following hold 




+ cA^bufs =0, i = 0, 1, . . . , — 1, 




+ cA^^bu^ < 0, 


(3.13) 


cA^~^^x*^ + cA^bua = 0, j = 0, 1, . . . , - 1, 




cA^^^^x*^ + cA^^bua > 0. 


(3.14) 



Proof. This is obvious from Lemma 2.2.4. 

It is seen that if Ua — rijs = 0, then the trajectory of the limit cycle is non- 
tangent with the switching planes, Sa and S^, at the traversing points. The 
conditions in Lemma 3.1 also ensure that the vector fields point in the ‘right’ 
direction on both side of the switching planes, e.g., the nearby trajectories tra- 
verse the switching planes. Now, we analyze the trajectory of x{t) starting from 
a point near to Xq. The following lemma is with respect to the first switching 
instant. 



Lemma 3.3.2. For any given <5 > 0, there exists ej > 0 such that the trajectory 
of x{t) starting from TZes will intersect Sa at instant tsi and will leave Sa^S^a 
for S-a after instant ts, where t^i and ts satisfy h^ — 6 < tsi < ts < hp S. 

Proof. Intuitively, this is true by continuity. The detailed proof is given below. 
For ^ G [0, r -f the trajectory of x* is governed by 
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x*{t) = f ^^bupds. 

Jo 

For some Si satisfying 0 < < min{/i/ 3 ,r, 5}, it holds that 



(3.15) 



cx*{t) > a, for t e [ 0 ,/i/ 3 ), 
cx*{t) < a, for t e {h( 3 , + Si], 

cx*{hi 3 ) = a. 

The trajectory of x{t) starting from xq = Xq A e TZe^ is governed by 

x{t) = e"^^{xQ A) + f e^^^~^^buf 3 ds (3.16) 

Jo 

for small f > 0. By continuity, there is a scalar esi satisfying 0 < eji < ci such 
that (3.16) holds for all ||zl|| < e^i and meanwhile 



cx{t) > a, Vt G [0, his — (Si]. 

This implies that for all |lZ\|| < e^ji, the trajectory of x{t) will not intersect Sa 
for t G [0, hp — Si], Since cx*{his-\-Si) < a, there exists es satisfying 0 < ej < e^i 
such that 



cx*{hp + (Si) + < a, V||Z\|| < es. (3.17) 

Next we show that for all ||Zlll < es, the trajectory of x{t) must intersect <5^ 
at some instant tsi and will leave Sa U 5+a for S-a after instant ts, where tsi 
and ts satisfy — S < tsi < ts < hfs S. We prove this by contradiction. If 
this is not the case, then for all t G [h/s — (Si, + Si], the relay remains Ufs and 
the trajectory of x{t) will be governed by (3.16) satisfying 

cx{i) > a. (3.18) 

However, taking into account (3.17), we have from (3.15) and (3.16) that 

cx{his 4- ^i) = cx*{his + (Si) + A < a, (3.19) 

which contradicts (3.18). This completes the proof. 



Remark 3.3.1. In Lemma 3.3.2, we see that tsi is an intersecting instant. It 
is easy to show that there is no sliding motion in the time interval [tsi, ts], 
and thus ts is a traversing instant. However, the type of motion characteristic 
between the intersecting instant and the traversing instant does not affect our 
investigation on the stability of the limit cycle. Our concern in the development 
is the traversing instant which plays an important role in the local stability 
analysis. 
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For t € 


E, define 






Fait) : 




- 1)< + 


f e^^hupds, 
Jo 




fait) ■ 


= cFait), 






Fpit) : 


= (e^* 


- I)X0 + 


[ e^^huads, 
Jo 




Mt) ■■ 


= cF/sit). 




(3.20) 


Using (3.13) and 


(3.14), it is easy to verify that 




lim = 

t-fO f"a+l 


1 

(jla + 1)! 


(cA"“+^x* + cA'^’^hup) < 0, 




lim *<*> = 

t^O + 1 


1 

inp + 1)! 


+ cA"^6uc) > 0. 


(3.21) 


By defining 








fait) 




lim ^“<5 






fUcc+l 


t=0 


t^o 


5 




fisit) 




lim 






friff+1 


t=0 


J.XxXX , ... 

t-^O 


? 




there exist 


two scalars r* > 


0 and > 0 such that 


< 0 and > 0 



are continuous on t C [— r* , r*] and t G [— r^], respectively. Let 



= min{fta, h, r* , r^}. (3.22) 

Lemma 3.3.2 characterizes the trajectory of x{t) at the first traversing in- 
stant. To study the local stability of x* , we need to verify whether or not 
successive switchings can occur. The next lemma is useful, and characterizes 
a fixed scalar es^ > 0 such that any trajectory evolving from the traversing 
points within csq distance of x* (or x^) will intersect and traverse Sp (or Sa)- 

Lemma 3.3.3. For any given 5 q G (0,r^in]; there exists a fixed scalar csq > 0 
such that the trajectory of x{t) evolving from any traversing point in 
(or (here, set the traversing instant to he zero) will traverse Sp (or 

Sa), CLTid the traversing instant r + Urav satisfies ha — Sq < Urav < ha + So (or 
hp (5q tf'pdy hp H” Sq)- 

Proof. Firstly, consider the trajectory of x{t) evolving from traversing points 
in Sa- The trajectory of x*{t) is governed by 

x*{t) = e^^x^, + [ e^^^~^^hupds, Vt G [0,r], 

Jo 

x*(f) = + f e^^^~^^bupds f e^^^~'^~^^huads, "it e [t,t + ha]- 

Jo Jo 




46 



3. Local Stability of Limit Cycles 



The trajectory of x{t) evolving from = x* + Zi G 5^ with small ||Z\|| is 
governed by 

x{t) = + Z\) + / Vt G [0,r], 

Jo 

x{t) = + A) f e^^^~'^~^^buads^ 

Jo Jo 

Vt G [r,r + ^2], 

cx{t) < P, \/t e [0, r + 62 ], 

where S 2 > 0 is a sufficiently small scalar. Similar to the proof of Lemma 
3.3.2, by comparing the two trajectories of x{t) and x*{t), it can be shown that 
there exists csqI such that the trajectory of x{t) evolving from x^ = x"^ + A e 
^{esoi,x^) traverse S^. Moreover, the traversing instant r + ttrav satisfies 
h(x (^1 ^ ^trav ^ b/Q( “h ^i, and thus ho- (^0 ^ ^trav ^ b/(x “h ^ 0 * 

Next, consider the trajectory of x{t) evolving from traversing points in Sp. 
Similarly, for the given Jq > 0, there exists eso 2 such that the trajectory of x{t) 
evolving from ^{esQ2,x*) will traverse <Sq;, and the traversing instant t “h ttrav 
satisfies hj^ — 8 q < ttrav < hp + Jo- Now, let csq = minje^oi, €Sq 2 }> Then, the 
result follows immediately. 



The following lemma characterizes the first traversing point of x(t) starting 
from a region close to x ^ . 



Lemma 3.3.4. There exists €2 satisfying 0 < €2 < ei such that any trajectory 
of system E starting from xq = Xq A £ will intersect and traverse Sa, 
and the traversing instant ti and the traversing point x{t\) satisfy 



x{ti) - < 



Fajh - hj3)c 
fai^l ^/S) 



e^*M. 



(3.23) 



Proof From Lemma 3.3.2, there exists C 2 satisfying 0 < C 2 < ci such that the 
trajectory of x{t) starting from TZc 2 will traverse Sa at some instant ti, where 
ti satisfies \ti — h^\ < rmin- Since 

a;; = 

Jo 

ca:* = a, 

pti 

x{ti) = {x*o + A) + 

Jo 

cx{ti) = a, (3.24) 



after some simple manipulations, we have 
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ce^*M + - I)xl + c C ^ e^^bupds = 0, 

Jo 



or, 



+ fa{h - hp) = 0. 

Noting that {ti — — hp) is well-defined for \ti — hp\ < rmin, the 

above equation yields that 



u u ^n„+l _ ih - 
Using (3.24), we get 



rti—h^ 



x{ti) - < = - /)X* + f ' e^^bupds 

Jo 

- (f _ /j \nc+i 

V fa{tl hp) J 

This completes the proof. 



(3.25) 



Let Z\i = x(ti) — X* . By virtue of Lemma 3.3.2, \ti — hp\ can be made 
arbitrarily small by choosing ||Z\|| sufficiently small, and thus \\Ai\\ can be 
arbitrarily small. (See Remark 3.3.2 later for an alternative depiction.) The 
next lemma concerns the second traversing point of x{t) close to x*^. 

Lemma 3.3.5. There exists €3 satisfying 0 < €3 < 62 such that any trajectory 
of system E starting from xq = Xq + A £ IZe^ will intersect and traverse Sp 
after the first traversing instant t\, and the second traversing point x{ti-\-r+t 2 ) 
satisfies 

+ r + w - 4 = (; - ^1^) (3.26) 

where r + t 2 with t 2 > 0 is the time taken for the trajectory to move from x{ti) 
to x{ti + r + ^ 2 )- 

Proof. Similar to the proof of Lemma 3.3.2, it is easy to show that if zii is 
small, then the trajectory evolving from x{ti) = Z\i -h x* C 5^ will traverse 
Sp, and the time r + ^2 can be made approaching r + /i^. Thus, there exists €3 
satisfying 0 < 63 < 62 such that any trajectory of system E starting from TZe^ 
will make the time duration r + ^2 satisfy \t 2 — ha\ < Vjnin- Since 
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cx} = /?, 



* + founds + [ " e^^'^°--^'>buads, 

Jo Jo 



xih + T + <2) = + r e^^^+*^-^^bu0ds + e^^*^~^huads, 

Jo Jo 

cx{ti -\-T + t 2 ) = P, (3.27) 

after some manipulations, we have 



ce^(r+t2)^^ ^ ^ e^^bucds = 0, 

Jo 



or 



ce^^-+*^^Ai+f0(t2-K) = O. 

Noting that (t 2 — — ha) is well-defined for 1*2 - ha\ < Tmin, we 

arrive at 

Using (3.27), we obtain 

x(*i +T + t2)-x*0= - l)x*0 + [ 

Jo 



(3.28) 



2 



e^^buads 






This completes the proof. 

Remark 3.3.2. Let 

^TT/q; ~1"1 I I I I 

Ml = max > 0 , 

te[-rmin,rmin] 



M2 — max 

^G[ l^min ^'f'min] 



-fait) 

^n^+1 ||^gA(r+/ia)g^t I 

fait) 



> 0. 



(3.29) 



From (3.25) and (3.28), we see that |*i < Mi||Z\|| and |* 2 < 

M2||Z\i|| hold under ||Zi|| < €3. Hence, \ti —h^\ -> 0 as ||zi|| — >• 0, and this leads 
to ||zii|| -A- 0 and \t 2 - ha\ 0. 



Similarly, by choosing xo close enough to Xq, the trajectory starting from xo 
can make the relay switch for the third time, fourth time, and so on. However, 
we could not specify a local region TZe in this way such that any trajectory 
starting from it will make the relay switch consecutively forever. To achieve 
this, we need the following lemma which is related to a Schur stability problem 
for discrete-time systems. 
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Lemma 3.3.6. Given a positive integer p, suppose that Ai,&ij G (% — 

1,2,... ,p; j = 1, 2, . . .) and p{AiA2 • • • Ap) < 1. Then, there exists 6 q > 0 such 
that for all ©ij satisfying \\©ij-Ai\\ < 6q, it holds || • * • &pj)\\ 0 

as k oo. 

Proof Due to p{AiA2‘"Ap) < 1, it is easy to see that there is a scalar 
6 > 0 such that for all ©i G satisfying ||0i|| < 6, it holds that 

II rij=i(^i ^2 " ' Ap-\- ©j)\\ — >* 0 as A: — 00 . For this 0 > 0, there exists > 0 
such that if \\©ij — Ai\\ <6 q, then the matrix ©ij©2j • • • ©pj can be expressed 
as 

©ij©2j * * * ^pj — A1A2 • • * Ap Oj 
where i?j satisfies \\Oj\\ < 0. This proves the lemma. 

With the above lemmas proven, we are now in a position to present the 
main result for the stability of the limit cycle x*{t). 




Proof. Suppose p{WiW2) < 1. By virtue of Lemma 3.3.6, there exists a scalar 
00 > 0 such that for all ©ij G (i = 1,2; j = 1,2, . . .) satisfying \\©ij - 

Wi\\ < 60, it holds that || Yl^=i{0ij&2j)\\ ^ 0 as ^ 00 . In other words, there 
is a positive integer Nq such that for all ©ij e R^^^ satisfying \\©ij-Wi\\ <0 q, 
No+k 

II n (01,(92^)11 < 1, VA: = 0,1,2,... (3.32) 

i=i 

For j = 1,2,. . ., let 



W{6^J,xl) = 
W{S2j,X*0) = 



. faiSlj) ) 

_ Fp{52j)c \ 

pA{r +/la+^2j ) 

MS2 j) ) 



(3.33) 
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where ^ 1^- It is seen that W{5ij,x''^) -)► W\ and W{62j,x*^) W2 as 

6ij -)• 0 for i = 1, 2 and j = 1,2, Thus, for the above > O5 there exists 

(5o > 0 such that the following hold. 

IWii,O-PFi||<0o, y\Sij\<6o, j = 

\\w{6^j,x})-W2\\<eo, y\S2j\<So, j = i, 2 ,.... ( 3 . 34 ) 

Let dmin — min{(5o, r^in} where Tmin is as in 3.22. For this Smin > 0, by 
Lemma 3.3.3, there exists a fixed scalar Cmin > 0 such that the trajectory of 
x{t) evolving from any traversing point in <S(e„;„,x;) (or will traverse 

Sfi (or Sa) by spending time r + Urav, where ttrav satisfies ha — Smin < Urav < 
ha + S min (or /i/3 - 

^min <tt rav < h/3 + 

Now, let 



m = max{||fFi||, \\W2W}, 
emin = min{€mm, 

By virtue of Lemmas 3.3.2 and 3.3.4, there exists a scalar e satisfying 0 < e < ei , 
such that any trajectory starting from xq = Xq - i- A e IZe will traverse Sa with 
the traversing instant ti and the traversing point Xi satisfying (3.23). Moreover, 
it holds that \\xi - x* || < Imin < ^min- We show next that for this e> O^TZe is 
a local stable region. This is two-folded, i.e., any trajectory starting from TZ^ 
will make the relay switch consecutively and converge to the limit cycle x* as 
t tends to plus infinity. Figures 3.1 and 3.2 illustrate this. 

Since ||xi — x* || < Cmin < second traversing will occur at S/s. By 

virtue of Lemma 3.3.5 and the above analysis, the second traversing point X2 
and the time r + ^2 for the trajectory of x{t) to move from xi to X2 satisfy (see 
(3.26)) 



1^2 ha\ ^ ^min: 



X2 -Xl^ / 



F s (^2 ha^C 



^ V" //3(*2 - ha) 

= W{t2-ha,xl)ixi-X*a). 



A{r+t2)(^ _ 



(Xi - X^) 



(3.36) 

(3.37) 



Prom (3.36), we see that (3.34) holds, yielding ||W(^2 - ha,x*^)\\ < w Oq. 
Thus, (3.37) gives 



||X2 X/s\\ ^ (w Oo^Cmin ^ ^min-) (3.38) 

which implies that the third traversing will occur at Sa - Let the third traversing 
point be X3 and the time for x(^) to move from X2 to X3 be r + ^3. Then, by 
virtue of Lemma 3.3.3 and from a similar deduction to that of Lemma 3.3.5, 
we have 
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I ^3 ^/3| ^ ^mim 

= Wm~ hff, x*J{x2 - x*0). 

Also, we have 

11^3 “ ^all ^ H” ^o) ^min ^ ^mim 

which implies that the fourth traversing will occur at S/s. The process continues. 
Let the (2 Aq + l)th traversing point at <5^ be X 2 Nq+i and the time for the 
trajectory of x{t) to move from X 2 Nq to X 2 Nq-^i be r + ^2iVo+i- Then, 



|^2iVo+l - his\ < ^mim 

= W{t2No-\-l - hp,X*^){x2No - Xp). 

Additionally, we have 

||^2iVo+l ^all — d" ^o) ^ ^min-) 

which implies that the (2Nq + 2)th traversing will occur at S^. Let the (2 Aq + 
2)th traversing point at 5^ be X 2 Nq ^-2 and the time for the trajectory of x{t) 
to move from X 2 Nq-\-i to X 2 Nq +2 be r + ^ 2 Aro+ 2 - Then, 



|^2ATo+2 ^a\ ^ 

X2No+ 2 — Xp = W(t2No-{-2 ~ ha^ X*p){x2No+l ~ ^a) 

= W{t2No+2 — ha,X*^) 

' No 

n W{t2j+1 - h0,X*JW{t2J - hc,x}) ] (X1 - xl). 

\,J = l 

Taking into account (3.32), it is easy to see that 



No 



ha-,Xp) 

j=l 



<1, 



which leads to 



lk2iVo+2 -^^11 < ||kT(^2iVo+2 - ha,xl)\\\\xi -X*|| < (tt; + 0o)emm < ^min^ 

This implies that the {2Nq + 3)th traversing will occur at Sa- Continuing the 
process and noting (3.32) we conclude that for any A: > 1, the {2Nq + 2fc)th 
and the (2A^o + 2A: + l)th traversing will occur. Let the (2iVo + 2A;)th and the 




52 



3. Local Stability of Limit Cycles 



(2A^o + 2fc + l)th traversing points be X2ATo+2ife C and X 2 No+ 2 k+i C Sa, 
respectively, and the time for the trajectory of x{t) to move from X 2 No+ 2 k-i 
to X2No+2k and from X2No-\-2k to X2No-\-2k+l be T + t2No-\-2k and T + ^2iVo+2A:+l, 
respectively. Then, we have 

|^2iVo+2A: ^a\ ^ ^min^ 

X2NQ+2k “ = W{t2No^-2k ~ X*^){x2No+2k-l ~ 

\\x2No-\-2k ^/3 li ^ ^mim 

|^2iVo+2fe+l - ^^1 < 

a^2ATo+2fc+l = W^(^2ATo+2fe+l “ h^,xl){x2No+2k ~ Xp), 

||^2Aro+2A:4-l “ ^a\\ — ^min- 

This shows that the relay will switch consecutively. 

To end the proof, it is sufficient to show that 



\\x 2 k+l - ^all ^0 as ife ^ 0. 
To see this, note that 



(3.39) 



X2k-\-l -Xl= - hp,xl)W{t2j -ha,x}^ [xi - X^), 

||T^(^2i-^a,X^)-TT2|| <^0, 

\\w{t2j+^-h^,xi)-w^\\<eo. 



Again, using Lemma 3.3.6, from the statement at the very beginning of the 
proof, (3.39) is fulfilled. This completes the proof of the theorem. 



Theorem 3.3.1 presents a criterion to check the local stability of the limit 
cycle X*. The idea is, under the given conditions, to find a scalar e > 0 such that 
any trajectory of system E starting from the region TZe of the form (3.10) will 
tend to the limit cycle x* and make the relay switch consecutively. The scalar 
e is a local stability bound around the initial condition Xq. Since p{W 2 Wi) = 
p{WiW 2 )^ we see that p{W 2 Wi) < 1 is also a sufficient condition for the local 
stability of the limit cycle in Form 3.1. This can also be verified by letting 
to = 0 correspond to a time instant when the relay switches from up to Ua- 

Remark 3.3.3. Note that the results in this chapter are for relay feedback sys- 
tems with time delay r > 0. If r = 0, the method used in this chapter is not 
applicable due to possible occurrence of multiple trajectories at the switching 
instants. We should make it clear that for the case r = 0, if both ria and np are 
computed to be zero, then the result in Theorem 3.3.1 still holds true. Indeed, 
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= 0 corresponds to the case that the trajectory of the limit cycle is 
non-tangent with the switching planes at the switching instants, like the case 
considered in Astrom (1995), Johansson et al. (1997) and Lin et al (2000). 



3.4 Extension 



In this section, we consider the local stability of a limit cycle with 2q {q > 1) 
switches per period. The limit cycle considered is as follows. 

Form 3.2. The limit cycle x* of system U, which traverses Sa and 5/3 at the 
traversing points G Sa and G 5/3 [i — 1,2, ... ,g), respectively, makes 
the relay switch 2q times per period. The period is + ^od + r + h^i) 

with hai > 0 and hpi > 0 (i = 1, 2, . . . , ^), where r + hai (resp. r + h^i) is the 
time taken for the trajectory of x* to move from x*^ to (resp. from x^- to 

^a(2+l))- 

Note that = x* ^ in Form 3.2. In the following, we give an extension 

result to Theorem 3.3.1. The techniques used remain the same, except that 
more analysis steps and more complicated formulas are involved. 

Similarly to Lemma 3.3.1, there exist 2q even integers nai,nj 3 i G A7, I = 
1, 2, . . . , such that 

cA^~^^x*^i + cA^bup = 0, i = 0, 1, . . . , - 1, 

_|_ cA^°^^bUis < 0 , 

cA^^^x*^i 4- cA^bua = 0, 2 = 0, 1, ... , — 1, 

+ cA^^^bua > 0, (3.40) 

hold for all I = 1, 2, . . . , The extended local stability result in this section is 
as follows. 



Theorem 3.4.1. The limit cycle x* in Form 3.2 is locally stable if for some 
k e {1,2,..., 2q}, it holds that 

p{WkWk-i • • • WiW2gW2,-i • • • Wk+i) < 1, (3.41) 



where, for I — l,2,...,q, 



/ _ A^-^{Axli+hUp)c \ 

V +6U/3)y 

^ / A-^^{Axli + hu^)c \ 
y {Ax*pi + hUa) j 



(3.42) 



HctCj hf,Q — • 
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Proof. By virtue of Lemmas 3. 3. 2-3.3. 5, based on Lemma 3.3.6, the proof fol- 
lows a similar line to that of Theorem 3.3.1, and thus is omitted here. 

Theorem 3.4.1 presents q conditions for the local stability of the limit cycle 
in Form 3.2. If any one of the q conditions is true, a stability bound e > 0 
can be found such that any trajectory of system E starting from the region 
TZe of the form (3.10) will tend to the limit cycle and make the relay switch 
consecutively. 

Finally, we give a numerical example to show the effectiveness and the use 
of the sufBcient conditions presented. 

Example 3.^.1. Consider system E with 

10 0 \l 

A= -1-2 1 , b= 1 , c = [1 0 0], 

10-1 1 

r = 0.1, a = —0.1, /? = 0.2, Ua = 2, U/s = —1. 

We check that A is not Hurwitz with A(A) = {1, —2, —1}, but the system has a 
limit cycle with four switches per period which meets Form 3.2. The limit cycle 
is shown in Figure 3.3. The period and the four traversing points are computed 
to be 
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u 




X 




Fig. 3.3. (a) The control u{t); (b) the trajectories of x*{t) = [xl{t) X 2 (t) 
(xl{t) solid, X 2 {t) dash-dot, xl{t) dashed) 



So, 





/ 


1 

o 

o 

o 

1 


\ 


\{WiWzW2W-i_) = A 




-0.1764 0.0055 0.0688 






V 


-0.1180 0 0.0743 


/ 



= {0, 0.0055, 0.0743}, 



which gives p{W 4 ,WsW 2 Wi) < 1. Hence, we conclude from Theorem 3.4.1 that 
the limit cycle is locally stable. 



4. Global Stability of Limit Cycles 



In this chapter, we study the global stability of limit cycles for relay feedback 
systems with the same form as in Chapters 1 and 2. We first assume there 
exists a certain type of limit cycles and investigate its global stability. The key 
idea is to reduce the global stability problem to the asymptotic stability of a 
discrete time system. We then, in Section 4.6, study the global convergence to 
a limit cycle without assuming its existence, by using the contraction mapping 
principle. 



4.1 Introduction 

In engineering practice, to verify the global stability of a limit cycle for a relay 
feedback system is more meaningful than the local stability. This is because 
global stability ensures that starting from any set point the system will be 
driven to converge to the periodic motions. However, theoretically, the analysis 
of the global stability of limit cycles is hard work. Megretski (1996) addressed 
the global stability of oscillations by considering systems in input-output forms, 
which suit processes having an impulse response sufficiently close, in a certain 
sense, to a second-order non-minimum phase process. The sufficient condition 
presented therein is based on inspection of the open-loop step response and 
its variance. Goncalves et al. (2001) investigated the global stability of sym- 
metric limit cycles with two switchings per period for delay-free systems. The 
sufficient conditions are given in terms of a set of linear matrix inequalities by 
finding the so-called surface Lyapunov function of Poincare maps. Under some 
assumptions, the result serves a class of relay feedback systems well. 

Experience indicates that a wide class of systems has a unique globally sta- 
ble limit cycle. It is known that the uniqueness of a limit cycle is necessary for 
its global stability. However, how to check the uniqueness of a limit cycle is a dif- 
ficulty. The available method is to compute the period of a possible limit cycle 
through numerical procedures, and then confirm that only one corresponds to 
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a limit cycle (Astrom, 1995; Goncalves et a/., 2001). If so, the traversing points 
can be computed straightforwardly with the known period. With this informa- 
tion, we are able to check the global stability of the limit cycle (Goncalves et 
a/., 2001; Lin et al, 2001). Thus, how to determine that a globally stable limit 
cycle exists without any information of a limit cycle deserves a study. 

In this chapter, we concentrate on the analysis of the global stability of 
limit cycles for SISO RFSs. Section 4.2 gives some preliminaries. Section 4.3 
establishes several useful lemmas for attaining the main results. Section 4.4 
studies the global stability of a limit cycle with two switchings per period. 
Section 4.5 presents an extension to the results in Section 4.4 for the case of 
more than two switchings per period. Section 4.6 studies the problem of the 
global convergence to a limit cycle without the assumption that a type of limit 
cycle exists. 



4.2 Problem Formulation 



The system considered remains the same as in Chapters 1 and 2. The plant is 
described by 

x(t) = Ax{t) -f bu{t — r) 

y(t) = exit) (4.1) 

where x{t) G y{t) G E and u{t — r) G M are the state, output and control 
input, respectively; 4, 6, c are constant real matrices or vectors with appropriate 
dimensions; r > 0 denotes the time delay. The plant has relay feedback: 



I U 0 , if y{t) > or y{t) > a and u{t-) =up, 
u(t) = < (4.2) 

I Ua, if y{t) < a, or y{t) < P and u{t-) = Ua, 



where a,/? G M with a < /3 denotes the hysteresis; Ua^Ufs G M and Ua ^ Uf^. 
The initial function u{i) for i G [— r, 0] is: 



up, 



u(i) = 



U(x , 



if 2/(0) > P 

if 2/(0) < a 



[ uo G ZY, if a < 2/(0) < P 



(4.3) 



where 



Li : — {'Uq;, 



(4.4) 
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As in Chapters 1 and 2, we call (4.1)-(4.3) a RFS and denote it by The 
notation Sa and denote the switching planes as in Chapter 1, and the sets 
5+a, S-a, and S-p are the same as defined there. 

We see that in the region <S +/3 or <S_y 3 D<S-f-a or S-a, the system Ur is a linear 
system with a fixed control u eU, and thus the existence and uniqueness of the 
system solution is guaranteed. Since a trajectory may intersect the switching 
planes, the situation may be changeable. It has been shown in Chapter 1 that 
for system Ur with r > 0, there exists a unique solution x{t) for alH > 0 for 
any initial condition xq. However, this is not true for r = 0. Let’s examine the 
following examples. 

Example 4-2.1. Consider system Ur with r = 0 and 




Uf 3 = —1, Ua = 1, 0 = 0.5, a = —0.5. 



We check that the trajectory of x{t) starting from any initial condition xq 
intersects <S /3 or <5^ for the first time at some time ti with a possible switch. 
However, it is easy to verify that the trajectory of x{t) exists only for t G [0, ^i]. 
After time ti , the trajectory cannot evolve any further. 

Example 1.4.2 in Chapter 1 shows the occurrence of sub-solutions or sub- 
trajectories. 

For the global convergence of system Ur , the existence of solutions to system 
Ur should be guaranteed for all t > 0 for any initial condition xq ^ . In this 

chapter, we always assume this property by default. 

4.3 Supporting Lemmas 

From Lemma 1.3.1 in Chapter 1, we see that there is no sliding motion around 
the intersecting point of a trajectory after it intersects Sjs (or Sa)- By virtue 
of this fact, with our default that a solution x{t) always exists with any ini- 
tial condition xq, we see that just after the intersecting instant, the trajectory 
of x{t) has at most two sub-trajectories: one traverses Sp (or Sa) at the in- 
tersecting point; one returns to S-p (or Note that for r == 0, the two 

sub-trajectories may occur simultaneously. For r > 0, there is only one tra- 
jectory, and if no early switches occur, the solution x{t) exists uniquely for all 
^ > 0. This characteristic will be useful for the global convergence analysis. 
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In the analysis of the global stability of a limit cycle, we always assume 
the existence of a certain type of limit cycle. Here and in Section 4.4, the limit 
cycle X* of system Ur is assumed to have two switchings per period, whose 
trajectory is transversal^ to Sa and Sp at the traversing points x* G Sa and 
x*^ e S 13 , respectively. The period of the limit cycle is Ta + T^s where > 0 
(resp. Tjs > 0) is the time taken for the trajectory of x* to move from x* to Xp 
(resp. from Xp to x*). See Figures 4.1 and 4.2 where x*{t) denotes the system 
solution corresponding to the limit cycle x * . 




Fig. 4.1. The trajectories of x*{t) and x{t) 



Obviously, the uniqueness of a limit cycle is a prerequisite for its global 
stability. However, uniqueness is not used in this chapter to deduce the suffi- 
cient conditions for the global stability of a limit cycle; on the other hand, our 
conditions that ensure the global stability of a limit cycle imply the uniqueness 
of the limit cycle. 

Due to the transversal condition of the limit cycle, the following is satisfied: 

cAx* + cbujs < 0, (4.5) 

cAx*p + cbua > 0. (4.6) 

Recall that if Assumption 2.2 is satisfied, the limit cycle period satisfies Ta > r, 
Tp > r, which can be computed by (see (2.26) in Chapter 2): 



^ A trajectory of x(t) is said to be transversal to Sa and S /3 at time tr if cx(tT-) 7^ 0. 
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a — c{I — ^i^^MTcc+Tfs r) _ ^A{Tp t)^a ^b{Ua ~ Uf^) - cA 

l 3 = c(I - - Ua) - cA~^bua- 



Once Ta and have been obtained, x* and are given as 

X* = (/ — e^i'^oc+T^)^-l (^^A{Tac+T^-r) _ 

Xp = {I — e^(^«+T/3)^-l^gA(T«+T^-r) _ ^A{Tac-r)^^A-'^b{Uf^ — Ua) ~ A~^bUa> 



From Lemma 2.2.2, any trajectory of system Er with A Hurwitz will even- 
tually enter and remain in the region i? of the form (2.2). So, under Assumption 
2.1, to study the global stability of the limit cycle x* is equivalent to considering 
the system trajectories in the region i?. Let 









UJ 



min 

0/3 - 



UJ 



max 

0/3 - 



, ,max 

^ra - 



UJ 



max 

r/3 — 



[3 — a 

||c||(wo + ||A- 16 Ua|l)’ 

G{0)ug - 13 

||c||(a;o + \\A-^bua\\)’ 

13 — a 

\\c\\{uJo + \\A-^U0\\y 

a — G{0 )ui3 

MioJo + \\A-^bu0\\y 

G{0)ug - P 

llclKwo + 2\\A-^bui3\\ + ||yl-i6ua||) ’ 
cn — G(0)uff 

IlclKwo + 2\\A-^bug\\ + \\A~''-buis\\) ' 



(4.7) 



The following lemma gives lower and upper bounds of the time between any 
two consecutive switchings in the region J7. These bounds will be used in es- 
tablishing the main result for the global stability of the limit cycle x*. 
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Lemma 4.3.1. Consider system Ur assume Assumption 2.1 holds. Then, 
in the region Q, the time ta (resp. t^) taken by a trajectory to go from the 
traversing point Xa ^ Cl a (resp. G O 13 ) to the traversing point Xjs G 
(resp. Xa G Oa) satisfies 
(i) for r — 



±min 

^Oa 


VI 

VI 


j.max 
^Oa 5 






(4.8) 


j.min 


<t 0 < 


A.max 






(4.9) 


where i^*", ioJf*? 


j.min 

^0(5 


and 


are such that the following hold: 




||e^< 


-I\\< 


, jmin 
<^0a : 


, Vt G [0, 


^min\ 
^Oa L 




||e^‘ 


\\<ujZ^\ ViG(C“", 


oo), 




||e^‘ 


-J||< 


, .min 
^0/3 ■ 


, Vi G [0, 


j.min\ 
^0(5 L 





||e^*|| < WoX. Vt G (Cr. 00 ); (4.10) 



(it) for T > 0, under Assumption 2.2, it holds that 

T<ta< tT^\ (4.11) 

T<t0< tf^\ (4.12) 

where t^f)^ and are such that the following hold: 

||e^(‘-^)|| < Vi € (C“^, oo), 

<a;X. Vi € (^^^“^ oo). (4.13) 

Proof, (i) We first show (4.8). Since 
x^ = e^^^Xa + [ e^^^°^~^^huads, 

Jo 

we have 

X)3 + A~^bUa = {Xa + A~^bUa)> 

Recall the fact that 

CXa = CXp = P, —cA~^b = G{ 0 ), ||^a||<Ct;05 \\x^\\<ooo. 

If > ta, then 

0 < /3 -a = c(e^‘“ - I){xa + A~^bua) < ||c||a;^*"(a;o + m“^6ua||) < ^ -a 
which is a contradiction. If ta > f^a^, then 
0 < G{0)ua — P = —ce^^°^{xa + A~^hua) 

< ||c|K“(<^0 + p-'&Wall) < G(0)«a - 0 
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which is also a contradiction. This proves (4.8). For (4.9), the proof follows a 
similar line. 

(ii) For r > 0, under Assumption 2.2, it is obvious that ta > r and tjs > r. 
Next we show ta < f^a^ (resp. tp < We prove this by contradiction. 

Since 

X0 = - I)A~^bua, 

(resp. Xa = e"^^^Xi 3 + - I)A~^bu 0 ,) 

and 

cxa — cx, cXj 3 =P^ —cA~^b = G{0), ||a:a||<a;o, \\x/3\\<oJo^ 

we have 



0 < G{0)ua -13 = -ce^^-Xa - c(e^*“ - 
-ce^(to.-r)A-^bUc. 

(resp. 0 < a — G{ 0 )ui 3 = ce^^^^xp + — e^^*’^~'^^)A~^hUa 

A-^hu^.) 



If ta > (resp. t 0 > then 



(resp. 



||gyl(t„-r)|| <^max ||g^t„ || < ^max^ 

||gA(t^-r)|| <^max || < > ) 



giving 



G(0K -0< *llc||(wo + 2\\A~^bu0\\ + ||^-'6n„||) < G(0)n„ - 0. 
(resp. a - G{O)u 0 < wJ?^“®||c||(wo + 2 \\A~''-bua\\ + ||A“^&u^||) < a - G(0)u^.) 

This shows a contradiction. Hence we have (4.11) and (4.12). This completes 
the proof. 



Remark 4^3.1. Lemma 4.3.1 gives lower and upper bounds for the time between 
any two consecutive switchings in the region i7. In fact, we are interested in 
reducing the lengths of the four intervals ('^5 

and (r, To achieve this, taking the interval [t'^a^, ^oa^] example, 

we need only to choose the new and denoted by and i'^a^, as 
follows. 

f™" = sup{C"}, C” satisfying (4.10), (4.14) 

C = inf{Cr>, Cr satisfying (4.10). (4.15) 

Similar refined arguments apply to the other three time intervals. The proof 
of Lemma 4.3.1 also provides a method to compute a bound Tmin > 0 on the 
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time delay r such that, for system Er with 0 < r < Tmim the time between 
any two consecutive switchings of a trajectory is longer than r provided that 
the trajectory enters the region Q. This is done in the following remark. 

Remark J^.S.2. Let and be as in Lemma 4.3.1 (or as the refined 
versions in Remark 4.3.1). It is not hard to see that for system Er with 
r < min{^^^^, no early switches will occur when a trajectory enters 

the region /?. (Otherwise, it will lead to a contradiction by virtue of the proof 
of Lemma 4.3.1 (i).) Now, let Tmin be such that 

||e^‘ - 7|| < £o, Vi e [0, Tmin], 
where 

_ P — a 
||c||(wo +Wa/3)’ 

LJa0 = max{2||A“^6u^|| + \\A~^bUa\\, 2||yl~^6ua|| + \\A~^bu0\\). 

Then we conclude that for system Er with r < when a trajectory enters 
the region i?, the time between any two consecutive switchings is longer than 
r. Indeed, we notice that Tmin < minj^^^’^, and So, r < Tmin ensures 

that no early switches occur when a trajectory enters the region i?. Due to 
the possible occurrence of early switches before the trajectory enters i?, it may 
spend a time h from Xa ^ to Xj 3 e 0(3 (or, from X (3 £ 0(3 to x^ ^ Oa)- 
Without loss of generality, suppose the relay switches at most one time during 
the time h. (The following verification of a contradiction is still valid if the 
relay switches more than once during the time h.) We show h > r. Otherwise, 
if h < r < Tmin, this will lead to a contradiction. In fact, it is seen that 

Xp Xq, 

= (e^'* - I)xa + - I)A~^bu2 

(or, Xa - X0 

= (e^'* - I)x0 + - I)A~Hu2) 

holds for some th G [0, h] and ui £ U, i = 1,2, with ui / t/2- Noticing that 
cXa = oc, cxp = lla^c^ll < (Jo and ||a:^|| < cjq, the above yields 

/3 - a < ||c||£oWo + 2 £o||c||||^“^ 6 ui|| + £o||c||m“^6u2|| < 0 - a, 
which is a contradiction. 



4.4 Global Stability of Limit Cycles 

We turn now to the global stability of x* under Assumption 2.1 and Assump- 
tion 2.2 (for T > 0 only). Starting from any initial condition xq E the 
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trajectory of x{t) will eventually enter the region i? and will traverse Sa and 
S /3 consecutively. Let the first traversing point in and Qjs be Xai and xpi^ 
respectively. Note that Xai and x^i are determined by xq E MT' . For the tra- 
jectory of x{t) with first traversing points Xai G f2a and xpi G i?/ 3 , let the 
consecutive traversing point in and i ?/3 be Xod and Xfsi^ i = 2, 3,..., respec- 
tively; let the time taken for x{t) to go from Xai to be tai-, and that from 
x^i to Xa{i-^i) be tpi. See Figures 4.1 and 4.2 for illustrations. By Lemma 4.3.1, 
it is obvious that 



for r = 0 , 



J.m^n c' f 4.max 

5 

4.min ^ 4 -^ <f' +max 

^0^ ^ ^ t'O/3 ’ 



(4.16) 



for r > 0 , 



T < fai < 
T<t0i< 



For simplicity, let 






(4.17) 



t 



amin 



Cj", for r = 0 , 
r, for r > 0 , 



for r = 0 , 
for r > 0 , 



_ I Cr, for T = 0 

^(3min — \ ^(5max 

I r, for r > 0 , 

Now, define 

F0{t) := (e^‘ - /)(a;^ + A~'^hua), 
fgit) := cF/ 3 (t), 

F’o(t) := (e^‘ - 7)« + A“^6u/j), 

/o(t) := cF„(t), 



and 



for r = 0 , 
^max^ for r > 0 . 



(4.18) 



(4.19) 



f‘'V/3(f)lt=o := |™*~V;S(f) = +c6Ua > 0, 
t~^fa{t)\t =0 ■= limt~^fa{t) = cAx*^ +cbU 0 < 0 , 
f“^F/3(t)|t=o limt“^F,g(f) = Ax*0 + bua, 

t~^Fa{t)\t=o ■■= lim t~^Fa{t) = Axl, + bup. (4.20) 

Then, and t^^Fa{t) are continuous on t. Since 

0 and 7 ^ 0 for t = T„ and t = T^, respectively, then they 

will still be valid in some time intervals containing or T^. We assume that 
the intervals can be extended to [tamin, tamax] and [t^min, t/3max], respectively, 
which is equivalent to the following. 
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Assumption 4.1 Let 

Mt- Tot) ^ 0? Vt G \totmin') ^amax ^ / Ta, 
fa{^ ~ Tf^) ^0, G [^/3mm) t^max\'> t ^ 



(4.21) 

(4.22) 



Recall that we need only confine the study to the region i7. So, in what 
follows, for a trajectory of x{t), without loss of generality, let ^ 0 correspond 

to the first traversing point Xai G i?a* Since for r > 0, 

x{t) = e^^^Xai -1- [ 

Jo 

= e^^{xoti + A~^bu^) - A~^buj 3 , Wt G [0,r], 

nt-T 



(4.23) 



x(t) 



= pMt- 



'^^x{t) + f ^ ^^buotds 

Jo 



= e^^(xo,i + A~^buf 3 ) + A~^b{ua ~ up) - A~^bua, Vt G [r, tai], 

we have 

Xp = + A~^bup) + A~^b{ua — up) — A~^bua, (4.24) 

xpi = {xai + A~^bup) + A~^b{ua — up) — A~^bua- (4.25) 

Multiplying (4.24) by and combining with (4.25), we get 

xpi -Xp = e^^°^^{xoti - x^) + (e^(^«i-^«) _ I){x*^ + A~^bua). 

By Assumption 4.1, noting that cx*^ = cxpi = P, then 



(4.26) 



tal -Tot = -Ce^^°^^{Xal - O 



tal - Tot 



fp{tal — Ta) 

Since t~^Fp{t) is well defined for t G [tamin — Ta, tamax 
(4.27) into (4.26) gives 

X 01 -x *0 - - x*) + {tai - 



(4.27) 

Tot], substituting 



_ ^Atacl 



{Xal - o - ce^*°Ha;ai - xl)^^ — ^ 

J0{tal - ^a) 



(4.28) 



Similarly, from 

X* = {xp + A~^bua) + e^^'^^~'^^A~^b{up — Ua) — A~^bup, 

^a2 = + A~^bUa) + A~^b{up — Ua) ~ A~^bup, 

CX* = CXa2 = a, (4.29) 

we obtain 
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Xa2 - 

= - x}) + - J)« + A-^hu^) 

Fg{t0i — Tij)c \ Atm ( T — ~ Tg)c \ 

) \ f0{tal-Tc)J 



(4.30) 



= / 



fa{t01 2)3) 
Continuing the process, we have 






Xa{i-\-l) 

f j _ Fg{t(3i - T/g)c \ 

V fa{Hi-T^) ) 



J _ F(s{tgi Tg)c \ 
Mtgi-Tg) 



{Xod X^ ) 5 






(4.31) 



Thus, noting ||a:cti — II bounded by 2uq, where uq is as in (2.5) of Chapter 
2, the global stability of the limit cycle x* has been reduced to the asymptotic 
stability of a discrete-time system. That is, we have already established the 
following result. 



Theorem 4.4.1. Consider system Ur o>f^d suppose Assumptions 2.1, 2.2 (for 
T > 0 only) and 4-1 hold. The limit cycle x* is globally stable if the following 
linear time-varying discrete system is asymptotically stable: 



XiJ^\ — IV {t^i, tgi)Xi, i — 1,2,... 




(4.32) 


where 






W{t0i,tgi) = W(t0i)W{tgi), 




(4.33) 




t/Si ^ [I'pmin^ tp^nax]^ 






I'ai ^ [tamim ^amaa;]- 





Viewing (4.32) as a perturbed system due to the uncertainty of tgi and tjsi, 
we next solve the robust asymptotic stability problem. We use three methods 
to do this, and later in Remark 4.4.1 we compare the three methods. It is easy 
to verify from (4.20) that W{Tp,Tg) is well-defined and is given as 



W{TM=W{Tp)W{Tg) 



where 



W{T0)^(^I- 
W(T^) =(l- 



{Axl + buis)c 
c{Ax*a + bup) 

(Ax^ + bUa)c 
c{Ax*^ + bUa) 






(4.34) 



(4.35) 
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A. Norm constraint method 

The following result is straightforward. 

Proposition 4.4.1. If there exists a scalar 0 < 1 and an integer N >1 such 
that 

N 

II JJ tai)!! < 0, yti3i G [tprnin, tai ^ ^o:max]? (4*36) 

i=l 

then system (4.32) is asymptotically stable. 

To reduce conservativeness, it would be better for N to be chosen large. 
However, this makes computation difficult. 



B. Quadratic stability method 

This method says that if there exists a positive definite matrix P > 0 such that 

P-W^it0i,tai)PW{t0i,t^i}>O, Vi = 1,2,..., (4.37) 

then (4.32) is asymptotically stable. To achieve this, the following is a sufficient 
condition. 



Proposition 4.4.2. If there exists a positive definite matrix P > 0 such that 
P - W^iT0,Tc)PW(T0,Ta) > 0 (4.38) 

and 

P W^(T0,Tc) 

\\W{t0,ta)-W{T0,Ta)\\<amin 

_W(T0,Tc,) P-1 

Vi/3 € [i/3 minj tl3max]i ta ^ [tamim iamax]i (4.39) 

then system (4-32) is asymptotically stable. 



Proof. If the condition holds, then 

P W^{t^,ta)]^ 

_wm,ta) P-' J 

for all tp G [tfSmin, tfSmax] and toe ^ [tamin, tamax], which, using the Schur 
complement, is equivalent to the condition 

P-W'^{t0,to,)PW{t0,ta)>Q 

for &11 i /3 G \p0min^ i/ 3 T 7 iaa:] ia G [iaminj ictmax]* This implioS (4.37), dud 
thus system (4.32) is asymptotically stable. 




4.4 Global Stability of Limit Cycles 



69 



Also, conservativeness can be reduced if we use the following result. 



Proposition 4.4.3. If there exists a positive definite matrix P > 0 and an 
integer N >1 such that 

P - {W^{T0,Tc)fPW^{Tp,Ta) > 0 (4.40) 



and 



N 

\\Y[W{ti3i,t^i) - W^{T0,Tc,)\\ < (Jmin 

i=l 



P {W^{T0,Ta)V 
W^{T0,Tc) P-i 



€ [i|3 mim ipmax\j ^ai ^ [tamim tamax]^ ^ — 1,2, ...AT, (4.41) 

then system (4-S2) is asymptotically stable. 

Proof. The proof follows a similar line to that of Proposition 4.4.2. 



C. Parameter-dependent Lyapunov function method 

The idea of this method is to solve the robust stability problem by using 
the parameter-dependent Lyapunov function V (x) = x^P{x)x. The following 
lemma is useful for the development. 

Lemma 4.4.1. Let p{W{T^^Ta)) < 1 and let po satisfy p(TT(T/ 3 , Tc^)) < po < 
1. Then, 

(i) there exists <5q > 0 such that p{W{T^,Ta) 4- A) < po for all \\A\\ < So; 
(a) there exists m > 0 such that 

||(P^(r^,TJ + /i)*=|| <m(L^) , V||Zi|l<<5o, Vfc = 1,2,.... (4.42) 

Proof, (i) Since p{W{Ti 3 ,Ta)) < po < 1, we have p{pQ^W(Tp,Ta)) < 1. It is 
known that min|^l=i (Jmin{zl — pQ^W{Tj 3 ,Ta)) is exactly the complex stability 
radius of pQ^W{Ti 3 ,Ta) (Mori, 1990). Therefore, if 

IIPo^^II < (TminizI - Po^W{Tp,Ta)), 

\z\ = l 

then 

p{p^^W{T0,T^) + p^^A)<l, 

which yields 

p(W{T0,Ta) + A)<po. 



Hence a suitable 5o is given by 
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Po min aminizi ~ Po ^W{T0,Ta)). 

\z\=l 

(ii) By the Schur-Toeplitz theorem for triangularization (see Lancaster and 
Tismenetsky (1985), p.l76), for each A e satisfying ||zi|| < (So? there 

exists a unitary matrix Ua ^ such that 

^.1 :=U^{W{T0,T^) + A)Ua :={zij), = 

is an upper triangular matrix where the diagonal entries zu are the eigenvalues 
of W{Tp,Ta) + A. By virtue of (i), 

\^ii\ ^ Po 

kiil < = \\W{TM + ^11 < \\W{TM\\ + ^ 0 , for i < j. 

Let 

d = min|l, — ^ ^ / m. rrl >05 

1 2(n-l)(||W^(T^,T,)|l + (5o)/ 

D = diag{l, d, (T-i}, 

Za = D~^ZaD := (%), i,j = 1 , 2 , 

Then we have 

Zll dzi2 • ■ ■ dP'-^Zin 

0 ^22 • • • d^-^Z2n 

ll^^lloc = . . . 

0 0 * * • Zjin 

oo 

< Po + (||T^(Tp,r„)|| + So){d + . . . + 

<Po + (||T^(rp,Te,)|| + Jo)(n-l)d 

< 0.5(1 + Po) 

< 1 . 

Since for M e ||Z)“^MJ9||oo is also a matrix norm (see Lancaster and 

Tismenetsky (1985), p.359), there exists a scalar m > 0 such that ||M|| < 
m\\D-'^MD\\oo for all M G Therefore, 

\\{W{T0,Ta) + z\)''|| = IIZ^II < mllZilU < < m (1^) • 

This proves the lemma. 

The proof of Lemma 4.4.1 gives exact formulas for computing and m. It 
would be better if we could obtain po and Sq as large as they could be, and m 
as small as it could be. The next result is based on the parameter-dependent 
Lyapunov function method. 
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Proposition 4.4.4. System (4-32) is asymptotically stable, if p{W{Tp,Ta)) < 
1 and 



\\W{t0,ta)-W{T0,Tc,)\\<S, 

e [t0 min: ^/3mox]j ^ [^amin? ^amax]: 



where 



(4.43) 



(5 = min{(5o, 5i}, 

<5i = (4(||PF(T^,T„)|| + 5o)V) 




with po, (So and m as in Lemma 



(4.44) 



Proof. If (4.43) holds, then by Lemma 4.4.1, p{W{ti 3 i,tai)) < Po < 1 holds for 
^11 I'jSi ^ \pf3min'i ^/3maic] ^-Hd t(xi G [tamin') ^amax]' So, for each i =■ 1, 2 , . . ., we 
have that 

Pi — W {tpi,tai)PiW (tpijtai) = I 
for some Pi > 0. It is known (Robbe and Sadkane, 2000) that 

oo 

Pi = Y,{W^{t0i,tai))'^{W{t0i,tai)f . 

k=0 

Let the parameter-dependent Lyapunov function he V = XfPiXi. We show 
that V{Xi^i) — V{Xi) < 0. To do this, it is sufficient to show that 

Pi - W'^ [t0i,tod)Pi+lW {t0i,tai) = I + W^{t0i,tai){Pi - Pi+l)W {t0i,tai) > 0. 

With some manipulation, we see that 

i^Pi+l ~ Pi) ~ ^ if(5{i+l))l^a{i+l)){.Pi-\-l ~ Pi)^if(3{i+l))l'a{i-\-l)) ~ Q) 

where 

Q ~ ^ (^^(i+1) 5 ^a(i+l))-^i (^(^/3(i+l) ? ^a(i+l)) ~ ^ifl3i)^ai)) 

+ {W{t0i^i+l),ta(i0.i)) -W{t0i,tai)f PiW{t0i,tai). 

So, 

CXD 

Pi+l - Pi = '^{W^{tl3(i+l):ta(i+l)))''Q{W{t0(ij^l),to,{i+i)))'‘. 

k=0 

Taking into account the fact, for all i = 1, 2, . . ., that 
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k=0 k=0 ^ ' 

IIQII < 2{||W^(T^,r„)|| + 5o)||Pi||||W^(iW+i)>Mi+i)) - W{t0uUi)\\ 

<^{\\W{T0,T^)\\ + 6o)p5, 
we arrive at 

oo 

\\Pi+i-Pi\\ < ||Q||5]||(W^^(i^(i+i),ia(i+i)))'||||(W^(t^(i+i),t^^^^^ 

A;=0 

<(||W^(T^,r,)|| + (5or^ 

Hence, I H- W'^{t( 3 i,tai){Pi - Pi-\-i)W{t/ 3 i,toti) > 0 is satisfied. This completes 
the proof. 

Similarly to the former two methods (Propositions 4.4.1 and 4.4.3), to 
reduce conservativeness, we can use an integer N to check the condition 
p{W^ (Ti 3 ,Ta)) < 1 and establish a corresponding result. To save the space, we 
do not list it here. 

Remark 4-4- general, method A is simple but is the most conservative one 
among the three. Method B is more conservative than method C, since it needs 
to find a single matrix P > 0 while method C uses the parameter-dependent 
Lyapunov function. However, based on our extensive simulations, it is guessed 
that if Assumptions 2.1 and 2.2 (for r > 0 only) are satisfied, either there are 
more than one limit cycle (thus not globally stable) , or the limit cycle is globally 
stable, which can be checked by Proposition 4.4.1 or 4.4.3. This is largely owing 
to the observations that W^t^i) and W{tai) in (4.32) have special structures, 
e.g., 

• cW(tiSi) — cW (t(xi) = 0 , 

• rank(F/3c///3) = rank(Fcc//c) = 1; 

• 0 as ^ + 00 . 

These observations make our checking methods effective and we expect that 
a wide class of systems have a globally stable limit cycle. The next section 
extends the result to the case that a limit cycle makes the relay switch more 
than twice per period, and gives a simple numerical example to illustrate the 
use of the result. 

Remark 4-4 - is easy to see that if we let ^ = 0 correspond to the first 
traversing point Xjsi G i?^, similar analysis leads to a parallel result to Theorem 
4.4.1. That is, under Assumptions 2.1, 2.2 (for r > 0 only) and 4.1, the limit 
cycle X* is globally stable, if the following system is asymptotically stable. 
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Xij^i — W {tai, t(3i)Xi^ i — 1,2,... (4.45) 

where 

W{tai,t0i) = W{tai)W{t0i), 

tffi € [ti3 min’) t^max\') ^ai ^ ^amax]^ (4.46) 

and W{tai) and W(t^i) are as in Theorem 4.4.1. Accordingly, sufficient results 
analogous to Propositions 4.4. 1-4.4. 3 can be established. 



So far in this section we have studied the global stability problem for system 
Sr. The limit cycle considered may not be symmetric. Because time-delay 
systems are of considerable interest from an engineering point of view (most 
industrial processes have time delay) , the method presented in this section gives 
a unified approach for both r = 0 and r > 0. For delay-free systems (r = 0) of 
the form Sr with /? = —a and Ua = = 1, Goncalves et al. (2001) studies 

the global stability problem for symmetric limit cycles with two switchings per 
period. The method involves finding a single matrix P > 0 for the so-called 
surface Lyapunov function of Poincare maps, which is related to method B in 
this section. Also, some other techniques (e.g. S-procedure) are used to reduce 
the conservativeness. 



4.5 Extensions 

In the preceding section, the limit cycle is assumed to be of two switchings 
per period. This section studies the global stability of a limit cycle with more 
than two switchings per period, and shows that the corresponding results can 
be obtained similarly. Let the limit cycle, still denoted by a;*, make the relay 
switch 2q times per period, where ^ is a positive integer. The limit cycle a:* 
is transversal to Sa and S(s at the traversing points a:*^ G and G Sp, 
2 = 1, 2, . . . , g, respectively. The period of x* is Yli=i + T^i) where T^i > 0 
(resp. TjSi > 0 ) is the time taken for the trajectory of the limit cycle to go from 
to (resp. from to 

It is seen that Tq^i G [taming ^amax] nnd T 0 i G ^ ~ 1? 2, . . . , 

where tamin, tamax, t^min and tffmax are given by (4.18). As in Section 4.4, for 
/ = 1, 2, . . . , ^, define 

fmit) ■= cF0i{t), 

Fai{t) := -I){xh+A-^hu0), 

fal{t) cFal{t), 



(4.47) 
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and 

i“V/3/(i)|t=o := = cAxh+cbua > 0, 

fai{t)\t=o ■■= lim = cAxh + cbuis < 0, 

t~^ F0i{t)\t=^o ■= lim = Ax*^i + bua, 

t^^Fai{t)\t=o ■= \i^t~^Fai{t) = Axh + bu0. (4.48) 

Then, and t~^Fai{t) are continuous on t. Since 

^ Q fcci{t-Ti 3 i) ^ Q ^ t — Tm, respectively, 

then they will still be valid for some time intervals containing Tai or T^i. We 
assume that the intervals can be extended to [taming tamax] and [t(^rnim *0 max \ • 

Assumption 4.2 Let, for allZ = 1, 2, . . . , g, 

fpi{^ ~ ^al) ^ d? G \t(xmin’i ^amaa:]? ^ ^ (4.49) 

fal{t ~ TfSl) ^ G \tf^rnim ^^macc]? ^ ^ ^/3Z- (4.50) 

The main result in this section is as follows. 



Theorem 4.5.1. Consider system Fr and suppose Assumptions 2.1, 2.2 (for 
r > 0 only) and J^.2 hold. The limit cycle x* is globally stable if for some 
k = 1,2, . . . ,2q, the following linear parameter-varying discrete system is 
asymptotically stable. 

Xi^,=Wi,kXi, i = l,2,... (4.51) 

where 



Wi^k = W{ti^k,ti,k-l, • • • ^ti^i,ti^2q,ti^2q-l, • • • ,^i,A;+l) (4-52) 

= W{ti^k)W{ti,k-l) . . . W{ti,i)W{ti,2q)W{ti^2q-l) • • • W{U,k+l) 



and 



TJ7/J. \ f T Fpi(ti^2l — 1 ^Ati 2Z-1 4- r- -I- 1 

V J^l[ti,2l-1 - J-al) ) 

Fal{ti,2l - T0i)c\ A^. 



W{ti,2l) = I 



fal{ti,2l - T0l) 
l = l,2,...,q. 



e ti^2i e [t0 min') l^^max\’) 



(4.53) 



Proof. The proof is similar to the process for attaining Theorem 4.4.1 or the 
result in Remark 4.4.2, and thus is omitted here. 



For simplicity, let 
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Tk={ k=l,2,...,2q, 1=1, 2,. ..,q. ( 4 . 54 ) 

[ Tpi, if k = 21, 

Then, W {Tk,Tk~i,. ■ . , Ti, T2,, T2g_i, . . . , Tk+i) is well-defined and is given as 
W{Tk,Tk~l, . . . ,Ti,T2q,T2q-l, . . . ,Tk+l) 

= WkWk-i . . . \V 1 W 2 qW 2 q- 1 . . . Wk+i ( 4 . 55 ) 



where 



If 



W21-1 



W21 = 



c(Ax^l + bUa) I 



_ (Ax* I + bUf3)c \ 

c{Ax*^i+hui3)) 



I — 1,2, ... ,q. 



(4.56) 



p(W^ (Tk,Tk-i,. . . ,T\,T2q,T2q-i, . . . ,Tk+i)) < 1 (4.57) 

holds for some integer iV > 1, then sufficient conditions for solving the asymp- 
totic stability of system (4.51) can be obtained analogous to Propositions 4.4.1- 
4.4.4. 



Remark 4-5.1. In Theorems 4.4.1 and 4.5.1, it is obvious that the sufficient 
conditions which guarantee the asymptotic stability of system (4.32) or (4.51) 
also imply uniqueness of the limit cycle x* . 

So far, we have established sufficient conditions, in Sections 4.4 and 4.5, 
for the global stability of a limit cycle. In practice, from our experience and 
extensive simulations, we notice that many relay feedback systems of the form 
Ur have limit cycles. A rough explanation for the global convergence to a limit 
cycle is addressed below. The condition (4.57) ensures the local stability of a 
limit cycle. (This is related to the local stability of x* , which can be verified 
using a similar method to that in Chapter 3.) If the limit cycle is unique, under 
Assumptions 2.1 and 2.2, the system trajectories will enter the region i?, and 
after some switchings, they will tend to x* under additional constraints. 

The following gives a simple numerical example to illustrate the use of the 
global stability result. 

Example 4-5.1. Consider Example 4.2.1 with A, b and c being unchanged and 
Ua = 3, up = —1, a = 0 and ^ = 1. It is easy to check that for r = 0, this 
system does not have a solution for alH > 0. However, for any r > 0, given 
any initial condition xq G M^, there is a solution x(^) (indeed unique) for all 
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u(t) 

1 1 

3 - r- 

2 - i : - 

1 - i •: - 

0 - i - 

-1 

I I 

0 5 10 15 



t 



x(t) 




Fig. 4.3. The control u{t) and the trajectory of x{t) = [xi{t) X 2 {t)]^ starting from 
[2 1]^ for Example 4.5.1 solid, X 2 {t) dashed) 



t > 0. Also, we check that for any r > 0, there is a limit cycle of the form in 
Section 4.4. Figure 4.3 shows the trajectory starting from [2 1]^ for r = 1. 

Now, we check the global stability of a limit cycle x* corresponding to a 
given r > 0. The validity of Assumptions 2.1 and 2.2 can easily be checked. 
The invariant region i? in (2.2) is computed to be i? = G : ||^|| < 3\/2}, 
and so uq = Sy/2. We further compute that and 

from (4.7); tamax = = r + 4\/2 and tj3max = = r + 10\/2 from (4.13) 

and (4.18). Letting x* = [ai a 2 ]^ and = [/?i /? 2]^5 we see from cx* = a 
and cx^ = p that ai = 0 and /3i = 1. The above gives that fa{t) = = 

e~^ — 1 ^ 0 for alH / 0, i.e.. Assumption 4.1 is satisfied. 

By using Theorem 4.4.1, to verify the global stability of the limit cycle, 
it is sufficient to check the asymptotic stability of the system (4.32), where 
W{tisi,tai) is computed to be 

0 0 
|(/ 32 - 3)1 






(4.58) 
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It is easy to check (from Proposition 4.4.1 or 4.4.3) that such a system is 
asymptotically stable. This concludes that the system in Example 4.5.1 with 
any r > 0 has a unique globally stable limit cycle. 

If we use system (4.45) in Remark 4.4.2 to check the global stability of the 
limit cycle, we have 






0 0 

-as - 1 1 



This gives the same conclusion. 



(4.59) 



4.6 Existence of Globally Stable Limit Cycles 

In Sections 4.4 and 4.5, the given global stability results serve a wide class of 
relay feedback systems well. Indeed under our assumptions, it is hard to find a 
numerical example which conflicts with the global stability condition. This also 
implies that a wide class of systems has a unique globally stable limit cycle. 
We can thus have the following conjecture: 

Conjecture: Suppose Assumptions 2.1 and 2.2 hold. If there is a unique limit 
cycle for system then the limit cycle is globally stable. 

It is known that the uniqueness of a limit cycle is necessary for its global 
stability. However, how to check the uniqueness of a limit cycle is difficult. The 
available method is to compute the period of a possible limit cycle through 
numerical procedures, and then confirm that only one corresponds to a limit 
cycle. Having obtained the period, the traversing points are computed straight- 
forwardly. With this information, we are able to check the global stability of 
the limit cycle. Thus, how to determine that there does exist a globally stable 
limit cycle without assuming the existence of a limit cycle deserves study. This 
section deals with this problem. 

4.6.1 Preliminaries 

We introduce some concepts and prepare some lemmas in this subsection. 

Definition 4.6.1. Let {M,d) be a metric space and D C M be a subset of M. 
A continuous mapping T : D M is said to be a contraction mapping if there 
exists a constant k G (0, 1) such that 



d{T{x), T{y)) < kd(x, y), \/x, y e M. 



(4.60) 
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The following is a famous result regarding the unique fixed-point. For its 
proof, refer to Farkas (1994), Khamsi and Kirk (2001) and Smart (1974). 

Lemma 4.6.1. (Banach’s Contraction Mapping Principle) Let T : D M 
he a contraction mapping defined on the closed subset D C M of the Banach 
space M. IfT{D) C D, then T has a unique fixed-point xq, and for each x ^ D, 

limn->oo^"'(^) = Xq. 

The above contraction mapping principle has the following extension. 

Corollary 4.6.1. Let T : D D he a mapping defined on the closed subset 
D C M of the Banach space M. If is a contraction mapping for some 
positive integer N, then T has a unique fixed-point. 

Proof. By Lemma 4.6.1, has a unique fixed-point xq. Hence 

T^+\xo) = T{T^{xo)) = T{xo), (4.61) 

which implies that T{xq) is also a fixed-point of T^. By uniqueness, it must 
hold that T{xq) = Xq. This shows Xq is a fixed-point of T. 

On the other hand, if T{yo) = yo, then T^{yo) = yo. This, again by unique- 
ness, gives yo = Xq, proving that Xq is the unique fixed-point of T. 

4.6.2 Sufficient Conditions 

It is known that under Assumptions 2.1 and 2.2 (for r > 0 only), any trajectory 
of system Ur will eventually enter the region i?. Moreover, for any trajectory in 
this invariant region, the time between any two successive traversing instants 
is within the interval ^amoa;] (^^ \tf3minj ^/3macc])' 

Let us consider two trajectories ^{t) and r]{t) for system Ur. In the region i7, 
let certain traversing points in Oa be and r/ai , respectively, and the succes- 

sive traversing points in lip be and 77/31, respectively. Let the consecutive 
traversing points in Qa and be and i = 2,3,..., respec- 

tively. Denote the time taken for ^{t) (resp. rj{t)) to go from (resp. rjai) to 
^I 3 i (resp. 77/3i) be t^ai (resp. tr^ai), and that from (resp. rj^i) to (resp. 

Ca(i+i)) be t^isi (resp. tjj^i). We now compare the distance between 77^2 — ^a 2 
and T]ai — • Since 

^(31 = + A~^bu^) + - u^) - A~^bua, (4.62) 

77^1 = e^^^“^(77ai + A~^bui3) + - u^) - A~^bua, (4.63) 

multiplying (4.62) by and combining with (4.63), we get 
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npi - (ricxi - Cal) + - /)(C/31 + A ^hua). (4.64) 

To proceed, we assume the following. 

Assumption 4.3 In the region i7, any system trajectory is transversal to Qa 
and i ?/3 at each of its traversing points. 

Define 

F{x0,t) := (e^* - I){x0 + A~^bua), 
f{x0,t) := cF{x0,t), 

F{xa,t) := (e^* - I){xa + A~^bu0), 

f{xa,t):=cF{xa,t). (4.65) 

Under Assumption 4.3, we see that for i = 1 , 2 , . . ., 

:= \im = cA^pi A cbua > 0 , 

t~^f{^ai,t)\t=0 ’= = cA^ai A cbu/s < 0, 

t~^F{^pi,t)\t=o := lim A^^si + bua, 

t~^F{^ai,t)\t=o := lim t~^F{^ai,t) A^^i + bu^, (4.66) 

and similar arguments apply with respect to r]{t). Then, t), t), 

t~'^F{^l 3 i, t), t~^F{^(Si,t), i), t-'^F{rjpi,t) and t-^F{r)^i, t) 

are continuous on t. Since / 0, 7^ 0, f{r]i 3 i,t) ^ 0 

and t~^f{rjai,t) ^ 0 hold for ^ = 0, then they will still be valid for some 

intervals containing ^ = 0. We assume that the intervals can be extended to 

[^amin tamax^ tamax ^amin ] and [tfs 

min i^max-) ^^max ^/Smin]* 

Assumption 4.4 For G Oa and Xjs G let 

f^X^^t) ^ 0, Vt G [tamin ~ ^amax’> ^amax ~ tamin\’> ^ ^ Oj 

f{Xa,t) ^0, G [tprnin ~ max') tj3max ^^min\') ^ ^ 0. (4.68) 



Under Assumption 4.4, noting = cq^i = (4.64) gives 



Hal = (»7al - Cal) 



fi^01,H 



I — t^al) 



Since t F*(^^i,t) is well defined for t G \tamin ^amax) ^amax Sub- 

stituting (4.69) into (4.64) gives 




80 



4. Global Stability of Limit Cycles 



mi - - Cal) + {tnal ~ t|al) 

^T)al 



I - (/,«! - ^„i). (4.70) 

J{^pl,^al — t^al) J 



Similarly, from 



ioc2 = + A~^buoc) + - Ua) - A~^buis, 

ria2 = + A~^bua) + A~^b{uis - u^) - A~^buf3, 

c^a2 = CT]a2 = a, (4.71) 



we obtain 



'Hot2 ^a2 

— - ^i3i) + - I){^a2 + A~^bu^) 



= I 



= I- 



F'{^a2^trjpl t^i^i)c 
f{^a2,tjjpi - t^pi) 
F{^a2^tr)pi — t^(3i)c 
/(^a2 5^77/31 “ ^^/3l) 

/(4/315 ^7)0.1 ^^al) 



-C/3i) 



^Atrj^l . 

e^‘”“i( 7 y„i - Cal). 



(4.72) 



The above equation shows the relationship between rja 2 — ^a 2 and r]ai — ^ai • 
So far, we have established the following result. 



Theorem 4.6.1. Suppose Assumptions 2.1, 2.2 (for r > 0 only), j^.S and 4-4 
hold. If there exists a constant k G (0, 1) such that 



(j _ F{Xa,t 2 -t 22 )c \ _ F{x 0 ,h ~ hl)c \ ^At^ 

V f{Xa,t 2 -t 22 ) J V f{xi 3 ,tl -tn) J 



< k, 



(4.73) 



V X G i3 ^ ^ ot ^ 

^ ^ 15^11 ^ \famiri') ^amax\-> ^ 2 5 ^22 ^ \f( 5 min’) ^^maa;]? 

then there is a globally stable limit cycle for system Ur- 

Proof. View Oa as a closed subset of the Banach space W where the norm is 
defined as the spectral norm || • ||. For an arbitrary traversing point Xa G i7a, 
define the image T{xa) of the mapping T as the successive traversing point in 
Qa- For the arbitrary trajectories of ^{t) and rj{t), let two specific traversing 
points in Qa bo r]ai,^ai- From the above analysis, the successive traversing 
points T]a 2 ^ia 2 G i?a are related by (4.72). In view of (4.73), we see that 
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\\Va2 - ^a2|| = \\T(Val) ~ T(Cal)|| < k\\T,cl ~ ^al||, 

which, by using Lemma 4.6.1, suggests that there is a fixed-point, say xo G 
of T. This implies that there is a trajectory which traverses fia at xq and still 
traverses it next time. Hence, the theorem is proved. 



Using Corollary 4.6.1, the following result is straightforward. 

Corollary 4.6.2. Suppose Assumptions 2.1, 2.2 (for r > 0 only), 4-3 and 4-4 
hold. If there exist a positive integer N and a constant k G (0, 1) such that 



n(- 

i=l ^ 



F{Xoti-)t2i t2i,2i^C 
f {Xaijt2i t2i,2i) 



A ^At2i ( j _ F{X0i,t2i-l — t2i-l,2i-l)c \ 

/ V f{Xi3i,t2i-l—t2i-l,2i-l) J 



,At2i-l 



< k, 



5 e Oa, (4.74) 

V Ij ^ [I'aminj ^amax]? G [tprairf) ^/3maa;]) 

then there is a globally stable limit cycle for system Ur- 

Indeed, the given result can be slightly generalized. To do this, we first 
introduce the concept of contractive mapping. 



Definition 4.6.2. A continuous mapping T : M M is said to be contractive 

if 

d{T(x),T(y)) < d{x, y), Vx, y e M. (4.75) 

The following result is proved in Khamsi and Kirk (2001). 

Lemma 4.6.2. Let (M, d) be a complete metric space and D C M be a compact 
subset. IfT : D D is a contractive mapping, then T has a unique fixed-point 
Xq, and for each x £ D, lim^_^oo T'^{x) = xq. 



Using Lemma 4.6.2, the following is a direct corollary which is a slight 
generalization of Corollary 4.6.2. 



Corollary 4.6.3. Suppose Assumptions 2.1, 2.2 (forr > 0 only), 4-3 and 4-4 
hold. If there exists a positive integer N such that 



YJ fr _ F{Xai,t2i - t2i,2i)c \ At2i fi 
fi V f{Xai^t 2 i-t 2 i, 2 i) J V 



F{Xj3i,t2i-l —t2i-l,2i- 



f (^X j^i, t2i — l 



z-l,2i-l)c \ 

i-l,2i-l) J 



At2i- 



< 1 , 



V X !^i G 12^5 X(xi G Hql-) (4.76) 

V ^2i— 1? ^2z— l,2z— 1 ^ {famin') l'amax\'> ^2n ^2i,2i ^ {f^miw) l'^max\'> 
then there is a globally stable limit cycle for system Ur . 
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Until now, the above analysis and results are with respect to the traversing 
points in 0^- Analogous results can easily be established if consideration is 
restricted to traversing points in We list one below which is analogous to 
Corollary 4.6.3. 

Corollary 4.6.4. Suppose Assumptions 2.1, 2.2 (for r > 0 only), 4-S and 4-4 
hold. If there exists a positive integer N such that 

j I^(^X0i,t2i ^2i,2i)c\ ^At2i f j F'{Xcx.i,t2i—\ t2i—l,2i — l)c 

f{X0i,t2i—t2i,2i) ) \ f{Xai^t2i-l—t2i-l,2i-l) 




At2i-i 



< 1 , 



V G ^cxi ^ ‘^Q!j (4.77) 

V t2i—l, ^2i— l,2i— 1 ^ [I'/Smim l'/3max]j ^2ij ^2i,2i ^ [tamin: I'amax]^ 

then there is a globally stable limit cycle for system Ur- 

Remark 4-6.1. If we already know that there is a globally stable limit cycle 
for system Er, then the location of the limit cycle can be specified through 
the limit points of all traversing points of a trajectory in and These 
limit points are exactly the traversing points of the limit cycle. The limit cycle 
period can then be computed using the information of these limit points. 

Finally, let us re-examine Example 4.5.1 with r > 0. The validity of As- 
sumptions 2.1 and 2.2 has been checked. Similar to the checking of Assumption 
4.1, we have that f{xa^t) = —^f{x( 3 ,t) = e~^ — 1 ^ 0 for alH / 0, i.e.. As- 
sumption 4.4 is satisfied. Since r > 0, at any intersecting point Xj 3 satisfying 
cx (3 = 13 we get 1//3 = c^Axp + hUa) = 2. Similarly, at any intersecting point 
Xa satisfying cx^ = a = 0, we have y^ = c{Axa H- bujs) = —1. This verifies 
Assumption 4.3. Next, we use Corollary 4.6.3 to check whether or not there is 
a globally stable limit cycle. 

For 

— [^l/3i ^20i\ € ^ai ~ ^2o:i] ^ 

and 



^2i — 15 ^2z— l,2i— 1 ^ [taming iamax]^ ^2^5 ^2i,2z ^ I'^r 



where — I'/Smin — ^ ? I'cxmax — r A\f^ and tj^Yjidx — T lOv^ (already 

computed in Example 4.5.1), we compute that 



( 



I- 



F(Xgi,t2i t2i^2i)c \ ^At2i f j 

f ~ t2i,2i) J \ 



F{x^i,t2i-l — t2i-l,2i-l)<^ 
f{X(3i,t2i-l — t2i-l,2i-l) 



e^t2i-i 



= e 



0 0 

2 ^) 1 
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Since X 2 ( 3 i is bounded by cjq — 3\/2, we see that there exists a positive integer 
N such that the condition in Corollary 4.6.3 holds. This concludes that the 
system in Example 4.5.1 with any r > 0 has a globally stable limit cycle. 

If we use Corollary 4.6.4 to check whether or not there is a globally stable 
limit cycle, we have 




— hi,2i) J \ 



l,2i— l)c 

f{p^ai^t2i—l ~ ^2i—l,2i—l) 









0 0 
~^2ai ~ 1 1 



where^2i-ij t2i-i,2i-i ^ i/3max ]? ^2i? ^2i,2i ^ \pamiri') ^amax\- This giveS 

the same conclusion. 




Part II 



Process Identification from Relay Feedback Test 




Introduction to Part II 



Among the many applications of relay feedback is process identification, pi- 
oneered by Astrom and Writtenmark (1984). Identifying an unknown system 
from some test on it has been an active area of research for several decades, 
involves many engineering and science disciplines, and is a broad topic itself. 
Very interesting features of the relay test are that it is a closed-loop test which 
keeps the process variable under control and is usually preferred to an open-loop 
test, and that a linear stable process with relay feedback is likely to automat- 
ically reach a sustained stationary oscillation, a limit cycle. Furthermore, the 
relay feedback technique does not require prior information about the system 
time constants to ensure a careful choice of the sampling period. The choice of 
the sampling period has always been a tricky problem for traditional param- 
eter estimation techniques. If the sampling interval is too long, the dynamics 
of the process will not be adequately captured in the data and the accuracy 
of the model subsequently obtained will be poor as a consequence. While a 
conservative safety-first approach to this decision may be to select the smallest 
sampling period supported by the data acquisition equipment, this would result 
in too much data collection with inconsequential information. Corrective action 
requires data decimation in the post-treatment phase, which for real-time pa- 
rameter estimation may not be tolerable. Spared from these cumbersome and 
difficult decisions, the relay feedback method is therefore an attractive method 
for process identification. 

From the amplitude and period of the oscillatory waveforms, information 
about the process critical point can easily be acquired. The Ziegler-Nichols- 
like rules may be used to tune simple controllers such as PID. Relay-based 
auto-tuning methods have been integrated into commercial controllers and are 
successful in many process control applications (Hagglund and Astrom, 1991; 
Astrom et a/., 1993; Astrdm and Hagglund, 1995). Years of industrial practice 
have shown that the main problems with current relay auto-tuning technology 
are: (i) Due to the adoption of a describing function approximation, estima- 
tion of the critical point is not accurate and could be fairly inaccurate under 
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some circumstance (Slotine and Li, 1991; Huang and Chen, 1996). (ii) Only 
crude PID controller settings can be obtained with this single point identified 
and the resulting performance may deteriorate for, say, oscillatory processes or 
processes with a long dead time. 

Several modified relay feedback identification methods have been reported 
(Li et al, 1991; Leva, 1993; Palmor et al, 1993; Palmor and Blau, 1994; Palmor 
et a/., 1995a; Tan et al, 1999; Yu, 1999). To identify two or more points on the 
process frequency response, additional linear components (or varying hysteresis 
width) have to be introduced and additional relay tests have to be performed. 
These methods are time consuming and the resulting estimation is still ap- 
proximate in nature since these methods make repeated use of the standard 
method. Consequently, it is important to develop techniques for identifying 
multiple and accurate points on the process frequency response from a single 
relay test, which is necessary for the enhancement of PID control performance 
and for auto-tuning advanced controllers. 

In our work (Wang et a/., 19976; Wang et a/., 1997c; Bi et al, 1997; Bi 
et a/., 1999; Wang et al, 1999a; Wang et al, 19996; Wang et a/., 1999c; Bi et 
al, 2000; Wang and Zhang, 2000; Wang et ah, 2000a; Wang et a/., 20016; Wang 
et a/., 2001 d; Wang and Zhang, 2001a; Wang and Zhang, 20016) to be included 
in this part, we improve relay identification in two directions: one is to modify 
the standard relay so as to have better excitation of the process at a number of 
important frequencies; the other is to devise new algorithms which make better 
use of the available information contained in the relay response. In the first cat- 
egory, biased, parasite and cascade relays are designed. In the second category, 
in addition to the steady-state response, the relay transient response, which 
has not been used by others, is employed with appropriate application of the 
fast Fourier transform. Improved identification is thus achieved. Other issues 
such as closed-loop testing, multivariable process identification and conversion 
from frequency response to transfer function are also addressed. 
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Suppose that a relay feedback system is stable and eventually yields limit cy- 
cles. The information contained in the limit cycles can be used for process 
frequency response estimation, as pioneered by Astrom and co-workers. Fun- 
damentals are first provided in Section 5.1, followed by their refinements in 
the subsequent sections, which expand applicability to more scenarios. Note 
that in this chapter, only stationery oscillations are used for process identifica- 
tion while the following chapter involves relay transient response. This chapter 
focuses on non-parametric models while Chapter 7 addresses conversion from 
frequency responses to transfer function models. 



5.1 Fundamentals 

Consider a single-input single-output process described by 
x{t) = Ax{t) + hu(t — L), 

y{i) = cx{t), (5.1) 

where x{t) G y{t) G M and u{t — r) G M are the state, output and control 
input, respectively; A, 6, c are constant real matrices or vectors with appropriate 
dimensions; L > 0 indicates the time delay. More often, we will use the transfer 
function representation of the process: 

Y{s) = G{s)U{s), (5.2) 

where 

G{s) = Go{s)e-^\ 

with Go ( 5 ) = c{sl — A)~^h being a strictly proper rational function. Let r{t) 
be the reference or the set-point for the process output y{t) to track. The error 
between them is 



e{t) = r{t)-y{t). 



(5.3) 
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Assume that the process is controlled by relay feedback: 

J if e(t) > e+, or e{t) > e_ and w(i_) = n+, 
u{t) = < (5.4) 

I if e{t) < S-, or e{t) < and u{t-) = 

where s+,S- G M with £- < £+ indicating hysteresis; //_,//+ G M and //_ ^ 

For easy reference, the relay function in (5.4), which maps e{t) to u{t), is 
denoted by p(e+, e_, /i^, /i_). Its functionality is shown in Figure 5.1. A relay 
is said to have hysteresis if £ 4 . 7 ^ 0 or S- 7 ^ 0 ; and to be symmetric if £+ = e, 
= — £, and = /i, /x_ = — /i, denoted by p(e,/x); otherwise, it is called 
a biased relay. The standard relay corresponds to a symmetric relay with no 
hysteresis and is denoted by p(/i). 





/ 


U 


\ 


/ 


/ 




£_ 










jU- 





Fig. 5.1. General relay function p(e+, e_,/i_(.,/x_) 



Due to time delay L > 0, we have to specify the initial function u{i) for 
i G [—1/, 0]. The most natural one, which is also used in practice, is 



u{i) = { 






if e( 0 ) > £+, 
if e( 0 ) < £-, 



\^uo eU, if €- < e( 0 ) < £ 4 -, 



(5.5) 



where 



U := {fj.-, (1+}. (5.6) 

This completes the description of a linear process with relay feedback control. 

We call (5.1)-(5.6) a relay feedback system (abbreviated as RFS), denote 
it by Ul, and depict it in Figure 5.2. Experience shows that a RFS is likely 
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to have limit cycle oscillations as its steady state. Readers are referred to Part 
I of this book for a detailed analysis of the existence and stability of limit 
cycles in RFS and to the next section for the simple case of first-order systems 
to get a rough idea on them. In relay feedback experiments for analysis and 
identification, the set-point r is always kept unchanged, and we thus assume 
r(t) = 0 throughout this chapter. Assume that a limit cycle results from a 
RFS. Our task for this chapter is to extract the process dynamic information 
from such a limit cycle. We will start with the simplest method, the describing 
function approximation. 




Fig. 5.2. Relay feedback system 



Describing Function Method The describing function method approxi- 
mates the relay with an “equivalent” linear time-invariant system. To this end, 
the input to the relay is assumed to be sinusoidal: 

e{t) = a sin ujt, 

and the resulting signals in the overall system are analyzed. Consider first the 
standard relay case. Then, the relay output u{t) in response to e{t) would be a 
square wave having a frequency cu and an amplitude equal to the relay output 
level jjL. Using Fourier’s series expansion, the periodic u{t) can be written as 

. 4// ^ sin(2fc — 

k=l 

The describing function (DF) of the relay, A'(a), is simply the complex ratio of 
the fundamental component of u{t) to the input sinusoid, i.e. 
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One sees that the DF analysis ignores harmonics beyond the fundamental com- 
ponent. The residual q is the entire sinusoidally-forced relay output minus the 
fundamental component, i.e. the part of the output that is ignored in the DF 
development, 

_ 4/z ^ sin(2A: — Vjujt 

^ 7T ^ 2fc — 1 
k=2 

In the DF analysis of the relay feedback system, the relay is replaced with its 
quasi-linear equivalent DF, and a self-sustained oscillation of amplitude a and 
frequency ojc is assumed. Then, for the process with the transfer function G{s)^ 
it follows from Figure 5.2 that the variables in the loop satisfy the following 
relations, 

E = -y, 

U = N(a)E, 

Y = G{juJe)U, 



This implies 



G(jujc) = - 



1 

NM 



Tra 



(5.7) 



which gives an estimation of the process frequency response at one frequency, 
the RFS oscillation frequency. 

The above DF analysis assumes that the Nyquist curve of G{jco) intersects 
with the real axis at in the complex plane. Recall that the inter- 

section point of a process Nyquist curve with the real axis is called the critical 
point of the process and defines the critical or ultimate frequency, (Ju^ of the 
process, for which 



arg{G{juju)} = ~ 



(5.8) 



We can thus estimate the ultimate frequency and ultimate gain ku by 






and 

k : - ^ ^ 

\G{jwu)\ \G{ju}c)\ Tra 



For experiment design, the standard relay has only one parameter to tune, 
the relay output amplitude /i. Large /i will cause strong excitation of the process 
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and thus better identification. On the other hand, a large signal will make the 
process output deviate further from its set-point, which is not desirable. The 
choice of // is thus a trade-off between identification and control performance, 
as always in any identification problem, and much depends on measurement 
noise in the process output. If permissible, the relay output level should be 
adjusted such that the oscillation amplitude of the process output is about 
three times as large as its noise band. If the adjustment is not possible for a 
limited testing time, /i may be set to 3-10 % of the maximum range of the 
manipulated variable. 

For preservation of regular relay switchings and estimating robustness 
against noise, it may be advantageous to replace a standard relay by a symmet- 
ric relay with suitable hysteresis so that the resultant system is less sensitive to 
measurement noise. The describing function of a (symmetric) hysteretic relay, 
p(e,yLt), is 

= r 

7r(V«^ — + je) 

The process frequency response, like the standard relay case, is estimated as 
the inverse negative describing function of the new relay 

= ~W) “ ■ 

In this case, the oscillation corresponds to the point where the negative inverse 
describing function of the relay crosses the Nyquist curve of the process as 
shown in Figure 5.3. 

Noise is always present in output measurements and a big concern for pro- 
cess identification since it uses noisy data from measurements. As mentioned, 
hysteresis in the relay is a simple way to reduce the influence of measurement 
noise. Before a relay test is performed, the noise bank in the process output 
measurements can be estimated using simple statistics. The hysteresis width, 
e, should be greater than the noise band to avoid wrong switchings in the relay 
output and is usually chosen to be twice the noise band (Hang et a/., 19936) so 
that reliable stationery oscillations can be produced, maintained and observed 
easily. Filtering is another possible anti-noise measure (Astrom and Written- 
mark, 1984). Note that noise is usually of high frequency while most processes 
are of low-pass nature. A low-pass filter may be employed to pre-process noisy 
output and the pre-processed data are then used for model estimation. The 
filter bandwidth is usually set to be 3-5 times higher than the process criti- 
cal frequency. Yet another anti-noise measure is to utilize multiple periods of 
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limit cycles instead of a single period so as to filter out noise by the averaging 
method. A detailed and quantified analysis of this is given in Section 5.3, where 
the disturbance issue is also addressed. 




Fig. 5.3. Negative inverse describing function of hysteretic relay 



Fourier Series Method The oscillation waveform of the relay input signal 
e(t) under a RFS is usually not precisely sinusoidal as assumed in the DF 
analysis above, which will thus cause estimation error. The error increases as 
the waveform differs from the sinusoidal function. For a linear process, this 
error can easily be removed by extracting the fundamental harmonics of both 
input and output of the linear process G{s) using the Fourier series method. 
The resulting formula for estimating the process frequency response at the 
oscillation frequency is 



G{jujc) 



Y{j0Jo) ^ flperiodyj*)^ 

UU^c) 



(5.9) 



where y{t) and u{t) are one period of the process output and input stationery 
oscillations, respectively. This formula holds for a general relay and is precise 
if the system does not have any noise or disturbance. 



Static Gain Estimation If the relay used is symmetric, the resulting 
limit cycles will also be symmetric. No DC components are contained in such 
oscillations. This enables one-point estimation only, as shown above. To further 
estimate the DC gain or static gain of the process, we may introduce a bias, 
either in the relay input (e+ ^ e_), or relay output (/x+ //_), or both, so 

as to create an asymmetric relay and asymmetric limit cycles in the process 
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output. If this is the case, the static gain can be obtained using the Fourier 
series expansion again as 



rm) = 

U(0) A,erioMt)df 



(5.10) 



5.2 First-order Modelling 

First-order plus dead time (FOPDT) transfer functions are often used in process 
modelling and control because of its simplicity although actual processes could 
be of high order. In general, relay feedback systems are a hard problem for 
theoretical analysis, see Part I of this book. For FOPDT processes, however, we 
are able to establish the complete results. They are presented in this section and 
give some idea of the existence of solutions, the existence of limit cycles, and the 
stability of limit cycles for relay feedback systems, without much mathematics. 
They also provide some feeling and insight into what will happen to relay 
feedback systems. The information on limit cycles is adequate to determine 
the FOPDT model and this is also covered in this section, after relay feedback 
theory. 

Relay Feedback Theory Let the process be represented by the first-order 
plus dead time transfer function, 

or in terms of a state space model, 
x(t) = ax{t) + bu{t — L), 

y{t) = cx{t), (5.12) 

where for a non-integral process with r 7^ (X), we have 

a = --, cb=—, (5.13) 

r T 

while for an integral process with r = 00, (5.11) reduces to G{s) = so 

that 

a = 0, cb — K. (5-14) 

Suppose that the process is under general relay feedback control as described 
by (5.4). Since r{t) — 0, the relay is given by 



I if y{t) > or y{t) > -6+ and u{t-) = 
u{t) = < 

I //+, if y{t) < — or y{t) < —S- and u{t-) = /x+. 



(5.15) 




96 



5. Relay Feedback and its Variations 



and the initial condition is 



u{i) = < 






if 2/(0) > 
if 2/(0) < -£+, 



\^uo eU, if -6+ < y{0) < -S-. 



(5.16) 



The resulting relay feedback system is rather simple and enables us to easily 
analyze it completely. It turns out that the results depend on the nature of the 
parameter r, whether it is positive, negative or zero, and have to be presented 
separately for these three different cases. 

In what follows, define the switching planes (which are “switching lines” for 
the present case of the first-order system): 



S^ :={^eR : c^ = -e-}, (5.17) 

S- :={^eR : c^ = -£+} . (5.18) 



Proposition 5.2.1. Consider a RFS for the stable process in the form of 
(5.11) with T > 0 (i.e., a < 0 in (5.12) ). 

(i) A unique solution exists for any given initial condition if and only if any 
of the following holds. 

(a) L > 0, 

(b) L = 0 and — <s+ > max{RT/i_, 

(c) L = 0 and —S- < min{RT//_, 

(d) L = and Kjjl^ < —S- and Kp- > — 

(a) A limit cycle exists if and only if L > 0 and > 

K[i-. If this is the case, the limit cycle is unique with two switchings per period. 

(Hi) If a limit cycle exists, then the limit cycle is globally stable. Moreover, 
for a given process, the limit cycle is the common trajectory after the first 
switch, independent of the initial conditions. 



Proof. We first show (i). For L > 0, it is easy to show that there exists a 
unique solution for any given initial condition. We now concentrate on the case 
for L = 0. Let the initial state xq satisfy cxq > — and the relay start at /x_. 
Then the trajectory of x{t) will be governed by 

x(t) — e^^{xo + ba~^fi-) — ba~^p-. (5.19) 

It is easy to see that if — > K/jl-, then x{t) will intersect S- at some instant 
ti > 0. However, if after t = ti, the trajectory x{t) cannot evolve. 

Otherwise, for ^ > 0, we have 



. ^ . I e“‘(-e+ - Kn+) + Kn+ > -s+, for u = fj.+ 

y{ti + t) = cx{ti + f) = < 

I e"^(— £+ — i^/i-) + KfjL- < — s+, for u = p- 
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which contradicts the control law (5.15). If -e+ > and —6:+ > FC/i+ 

after the instant t = ti, the trajectory will be governed by x{t) = e^^{x\ + 
5a” — 5a” Next, if we also check that if —e- > Kfi+ 

holds, a unique solution exists for any initial condition. For — < FC//_, if 
—E- < then a similar analysis leads to a unique solution for any initial 

condition if —E- < Kfi- also holds. So far, (i) is proved. 

Next we show (ii) and (hi). It is seen from the above that for L = 0, there 
is no limit cycle since the solution, if any, tends to Kfi- or For L > 0, 

if and only if > —E- > — > FC/x_, can the relay switch continuously. 
Moreover, any trajectory x{t) will traverse S- and 5 + at fixed points —e^/c 
and —E-jc^ respectively. This proves (ii) and (hi). 



Proposition 5.2.2. Consider a RFS for the unstable process in the form 
(5.11) with r < 0 (i.e.j a > 0 in (5.12) ). 

(i) A unique solution exists for any given initial condition if and only if any 
of the following holds. 

(a) L>0, 

(h) L = 0 and — < min{FC/i_, FC//+}, 

(c) L = 0 and —E- > max{FC/i_, FC//+}, 

(d) L = 0 and > —E- > — > Kfi-. 

(ii) A limit cycle exists if and only if Kfi^ < — < —E- < Kfi- and 



0 < L < min 




-e+ - Kn- ’ 



— r In 



-e- - Kfi+ j 



If this is the case, the limit cycle is unique with two switchings per period. 

(Hi) If a limit cycle exists, then the limit cycle is locally stable, and the 
stability range is Kfi^ < cx{G) < Kjjl-. Moreover, for the given process, the 
limit cycle is the common trajectory after the first switch, independent of the 
initial conditions in the stability range. 



Proof. We first show (i). For L > 0, it is easy to show that there exists a unique 
solution for any given initial condition. We now concentrate on the case L = 0. 
Let the initial state xq satisfy cxq > — and the relay start at jjl- . Then the 
trajectory of x{t) will be governed by 

x{t) = e^^(xo + 5a“^/i_) - 5a“^//_. (5.20) 

Since a > 0, it is easy to see that if —e^ < Kfi-, then for cxq > Kfi-, the 
relay will remain fi- for all ^ > 0; and for cxq < Kfi-, x{t) will intersect S- at 
some instant ti > 0. However, if — > Kfi^, after t — t\, the trajectory x{t) 
cannot evolve. Otherwise, for t > 0, we have 
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\ e<^\-e+- Kn+) + Kn+>-e+, iov u = n+ 

y{ti + t) = Cx{ti + ^) zr ^ 

I — Kfi-) + Kji- < — e+, for u = //_, 

which contradicts the control law (5.15). If -e+ < K^- and S- < Kfi+, 
after the instant t = ti, the trajectory will be governed by x{t) = e^^{xi + 
— 5a“^/x+. Next, if — > Kji-^ we check that if also —S- < Kfi^ 
holds, a unique solution exists for any initial condition. For — 6+ > RT/i_, if 
—8- > then a similar analysis leads to a unique solution for any initial 

condition if — 8 - > Kfi- also holds. So far, (i) is proved. 

Next we show (ii) and (iii). It is seen from the above that for L = 0, 
there is no limit cycle since the solution, if any, tends to +oo or — oo, or is 
equivalent to or K/x+/c. We now concentrate on L > 0. Without loss 

of generality, assume that cxq > —8-. It is easy to see, as for the case L = 0, 
that if cxo > Kfi-, then the trajectory x{t) starting from the initial condition 
xq exists for alH > 0 while it does not make the relay switch (i.e., u{t) =//_). 
Let the initial state xq satisfy Kfi- > cxq > —8-. Then the trajectory of x{t) 
will be governed by 

x(t) = e^^(xQ + ha~^ ji-) — ba~^ fi- 

until for some time t\ > 0, it satisfies cx{t\) = After t = ti, due to the 
time delay L > 0, the trajectory will satisfy 

x{ti +t)= e^^{x{ti) 4- ba~^fjL-) — 0 < t < L 

before the switch occurs at ^ = L. It is easy to check that cx{ti + 1) < — for 
all t G (0, L]. After time ti + L, the trajectory of x{t) will be governed by 

x{ti L + t) = e^^{x{ti + L) + (5.21) 



Similarly, the switch will occur if and only if 

cx{ti + L) + c6a" V+ > 0- (5.22) 

With some simple manipulation, we see that (5.22) is equivalent to 
K(/i+ -//_) 



0 < L < — r In ■ 



(5.23) 



-8-^ - K pl- 
under condition (5.23), for some time t 2 > 0, the trajectory in (5.21) satisfies 
cx{ti + L + ^ 2 ) = —S-- After time + L + ^ 2 ? due to the time delay L > 0, the 
trajectory will satisfy 

x(t\ L t 2 i) — e^^(x(ti H“ Z/ + ^ 2 ) ba ^/^+) — bu ^/i+, 0 ^ t ^ L 



before the switch occurs at + L + ^2 + Again, we can check that the next 
switch will occur if and only if 
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cx{t\ L 12 “h chcL <C 0. (5.24) 

Also, with some simple manipulation, we see that (5.24) holds if and only if 

(5.25) 

So, by combining (5.23) and (5.23), (ii) and (hi) are proved by noting that after 
time ti, the trajectory x{t) will be a limit cycle with two switchings per period. 
Moreover, any trajectory x{t) starting from < ca:(0) < KjjL- will traverse 
S- and 5+ at fixed points — £:+/c and — .s_/c, respectively. 

Proposition 5.2.3. Consider a RFS for the integral process in the form 
G{s) — (i.e., (5.12) with (5.14)^. 

(i) A unique solution exists for any given initial condition if and only if any 
of the following holds. 

(a) L>0, 

(b) L = 0 and 0 > max{Ac/i_, 

(c) L = 0 and 0 < min{Ae/i_, 

(d) L = 0 and k/jL- > 0 > 

(ii) A limit cycle exists if and only if L > 0 and > 0 > If this is 
the case, the limit cycle is unique with two switchings per period. 

(Hi) If a limit cycle exists, then the limit cycle is globally stable. Moreover, 
for the given process, the limit cycle is the common trajectory after the first 
switch, independent of the initial conditions. 

Proof. Noting that in this case the trajectories of x(t) and y(t) will be governed 

by 

x{t) = but + Xo, 

y{t) — K,ut + CXo, 

the proof is similar to but simpler than those for the case a ^ 0, and thus is 
omitted here. 

It can be checked that if there is a limit cycle for system (5.12), the relay 
switches at the instants when the trajectory y{t) — cx{t) reaches the peak 
values; see Figure 5.4. Based on the information on this and other points, we 
can derive expressions for the limit cycle amplitudes and periods and use them 
to find the parameters in the FOPDT model of the process. 



Parameter Estimation for Non-integral Processes Consider the case 
a ^ 0 (i.e., r ^ oo). Prom (5.12) and Figure 5.4(a), we can see that 
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-e 

(a) 

-e 



y 



(b) 



Fig. 5.4. Limit cycles for system ( 5 . 12 ) (a) a ^ 0; (b) a = 0 

A- = cxa- , 

xa- — + a~^b/jL-) — 

CX- = —£ 4 .. 

Taking into account (5.13), the above yields 

A- = - Kfj,-) + Kfi-. (5.26) 

Similarly, from 

= CXA + , 

xa + = e^^(x+ + a~^6/i+) — a“^6/i+, 

CXa = — 
we have 

- Kii+) + Kii+. (5.27) 

Let the time taken for the limit cycle to go from xa- (resp. xaj^) to xaj^ (resp. 
XA-) be T_ (resp. T+). Then, we get 
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XA+ = (xa_ + a — a 

CXA+ = 

CXA- = 



which gives, by taking into account (5.13), 
e-£'/^(_£_ - Kfx+) 



T_ = -rln 



Also, from 



e-i/r(_£_^ - K/x_) + K(n^- n+) ' 



xa_ = e“^+(ar^^ +a ^bfi-) — a 
CXA+ = A+, 

cxa- = A _, 



(5.28) 



we get 

T+ = 



—rln 



e-^/-^(-e+ - 



(5.29) 



Luyben (1987) proposed the following method for first-, second- and third- 
order process modelling (called the ATV method): (i) The ultimate gain and 
ultimate frequency are obtained by using Astrom’s auto-tuning method, (ii) 
The dead time is read off from the initial response of the system to the auto- 
tuning test, (iii) The steady- state gain is obtained from a steady-state model of 
the process, or by using the step response method (Luyben, 1990). (iv) First-, 
second- and third-order transfer functions are fitted to the data at zero and 
the ultimate frequencies. 



Table 5.1. Parameter estimation from biased relay 



Case 


Process 


Biased relay 


New methc 


d 


ATV method 




K 


T 


L 




T_ 




A_ 


K 


T 


L 


K 


T 


L 


1 


1 


2 


2 


2.79 


3.91 


0.859 


-0.480 


1.000 


1.999 


2.002 


1 


1.658 


2 


2 


1 


1 


3 


3.50 


4.18 


1.241 


-0.670 


1.000 


0.999 


3.006 


1 


1.042 


3 


3 


1 


5 


2 


3.44 


5.46 


0.497 


-0.299 


0.999 


4.990 


2.009 


1 


4.068 


2 


4 


1 


5 


1 


2.15 


3.65 


0.318 


-0.209 


1.001 


5.003 


1.004 


1 


4.055 


1 



In fact, the expressions (5.26)-(5.29) can be used to determine the three 
parameters in (5.11). However, they are coupled and nonlinear. Closed-form 
formulas for calculating the model parameters are not possible. Notice that 
for a biased relay, we can use (5.10) to find G(0) = K. Then, we obtain the 
normalized dead time, L = ^, from either (5.26) or (5.27), r from (5.28) 
or (5.29), and finally obtain L = tL. Simulation is carried out for processes 
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with different normalized dead time to illustrate the accuracy of the above 
identification method. The outputs of the biased relay are set at 1.3 and —0.7 
respectively, and the hysteresis of relay is made symmetrical and set at 0.1. 
The resultant limit cycles and model parameters are presented in Table 5.1. 
For comparison, the parameters obtained by the ATV (Luyben, 1987) are also 
given in Table 5.1, where it is assumed that the steady-state gain is known and 
the dead time is read exactly. 

In practice, many high-order processes can be well approximated by first- 
order plus dead time models. The proposed method can do so effectively. The 
results for some typical processes are listed in Table 5.2. The Nyquist curves of 
the real processes and the models are shown in Figure 5.5, and they are very 
close to each other over the phase range 0 to — tt . 

Table 5.2. FOPDT models for the high-order processes 



Case 


Process 


Model 


1 




1.00 -2.93s 


(2s+l)‘^^ 


4.072S+1 ^ 


2 


1 


1.00 -7.26s 


(25 + 1)^^ 


6.809S + 1 ^ 


3 


1 -0.5s 


1.00 -2.1s 




1.152S + 1 ^ 


4 


— s + 1 p — -s 


1.00 -4.24s 





2.99S + 1 ^ 



Integral Processes We now turn to the case a = 0 (i.e., r = oo), which 
implies integral processes. We compute as follows. It is obvious from Figure 5.4 
that 

A- = cbfji-L - (5.30) 

A+ = chfij^L — E-. (5.31) 

Prom 

Aj^ — chfi^T— -j- A — , 

A— — cbfi—T-\- -l- A_|_ 



and taking into account (5.14), we have 



/cL(/i+ — /i_) — -h £+ 

kL{/jL- — /i+) — s-^ -\-e- 
K/i- 



(5.32) 



(5.33) 
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-1 0 1-1 0 1 
3 4 

Fig. 5.5. Nyquist curves of processes and their FOPDT models 

(a: real process; b: model) 



5.3 Robustness Enhancement 

It is well known that the difficulty in system identification is attributed to the 
existence of noise and disturbance. Noise is inevitable in practical situations 
and it contaminates the sampled data as picked up by the sensors. It is of so 
much a concern that once the samples are corrupted, there is basically no means 
by which they can be totally recovered. Distortions of the identification results 
are bound to arise when the samples used are subjected to random effects. 
Though it is true that recovery of the samples is not possible, many statistical 
methods, such as the stochastic least square algorithm employed in parameter 
estimation (Franklin et al, 1994), have been devised to account for the effect 
of noise in the identification procedure. They essentially make use of the mean 
and variance characteristics of noise in their computations. In consideration of 
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the growing popularity of the use of relays in performing system identification, 
effective ways to minimize the effect of noise will be of much importance. This 
is especially so in situations where the amount of noise has become so large 
that it can no longer be ignored. 

Before we can work on the relevant design, we need first to study the nature 
and characteristics of noise. In most applications, noise is modelled as white 
noise with zero mean. White noise is the most random type of signal possible, 
so that any samples taken at different instants are totally uncorrelated. If the 
white noise concerned has zero mean, then it is likely that the noise can appar- 
ently be rejected by use of averaging, although it cannot be removed from the 
associated signals, and this is the main idea behind the method introduced in 
this section. To test the validity of the concept, the accuracy of the process gains 
at the critical point and the static frequency are evaluated by taking different 
numbers of limit cycles in the relay experiment. It is found that as samples are 
averaged over a larger number of limit cycles, the relative error in the process 
gains at the two frequencies drops, and the results conform to expectations. 
Apart from noise, disturbances are another common source of error in many 
identification problems. They can appear in many different forms depending 
on their sources. Some of the types of disturbances are load disturbances, mea- 
surement errors and parameter variations (Astrom and Writtenmark, 1984). In 
this section, disturbances due to offsets in measurement and load disturbances, 
which are typically modelled as steps acting in the loop, are considered. 

Suppose that a SISO linear plant is subjected to a relay test as shown in 
Figure 5.6, where white noise n{t) of zero mean acts in the loop through the 
sensor at the output of the plant, and w{t) is a constant disturbance. Consider 
first the disturbance-free case, i.e., w{t) = 0. With noise present in the system, 
the contaminated plant output y{t) is measured instead of the actual value 
y{t). If y{t) and u{t) are employed directly for identification, impaired results 
will be obtained. Since noise samples do not follow a traceable pattern and can 
assume any random value at different instants of time when they are picked 
up at different locations in the loop, they cannot be calculated or predicted 
from previous records and thus, the actual output is not recoverable from the 
corrupted samples. 

Despite the fact that signal corruption by noise is an irreversible process, the 
behaviour of noise can still be described by statistical measurements. Therefore, 
estimation of the actual signal y{t) from the infected y{t) to achieve more 
accurate identification results is always possible by examining the statistical 
properties of noise. We start by noting that the noise involved has zero mean. 
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Fig. 5.6. Relay feedback system with noise and disturbance 



This suggests that if a large number of samples extending over a sufficient 
number of periods (limit cycles) are collected and averaged out, it is possible 
to obtain a period of processed samples in which noise is significantly reduced. 
This is because noise attached to the different periods cancel each other and 
in the limit when the number of periods taken approaches infinity, the noise 
can be completely cancelled in the ideal situation. However, this is practically 
unattainable and it is usually sufficient to take up to a certain number of periods 
depending on the noise-to-signal ratio. 

Let the relay feedback system give rise to limit cycle oscillations and the 
oscillation frequency be c^c- Let y{t) be an estimate of one period of y{t) from 
y{t) using the averaging method. The associated frequency response G{juJc) 
can be obtained from y{t) and u{t) using the equation 



^ YUcVc) ^ flperiodVit)^ 
U{3^c) 



(5.34) 



Since the static gain of the process can be attained at the same time in the same 
relay test with no extra effort if biased relays are used in place of symmetrical 
relays, the second frequency point is conveniently chosen to correspond to the 
d.c. component of the process. The relevant frequency response G(0) is obtained 
from the equation 



M = ^lperiody(*)dt 



(5.35) 



It is, in essence, the ratio of the area of y{t) over one period to that of u{t). 

Two observations can be made in performing the relay experiment described 
above. First, if the noise power is high, the relay will be easily switched by noise 
on top of the switchings by the actual process output y{t). To overcome this 
problem, a higher hysteresis level can be used for situations with higher noise 
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power. A convenient indicator of the noise power is its standard deviation 
an and the two are related by Pn = a^. It is found from simulation studies 
that correct switchings can be achieved if the hysteresis level is set at twice 
the standard deviation of the noise together with an upper limit equal to 0.95 
times the minimum of the on and off relay output level. 

The second observation concerns the reliability of judging the period of 
the limit cycles from the separation between two switching points of the relay 
output at high noise power. To derive a more accurate value for the period, 
samples taken during the transient are excluded from the entire span of u{t). 
The total number of switching points N is then counted. If N is even, the last 
point is retrenched so as to keep N odd. This is to make sure that a window 
size of an integral number of periods is used since an odd value of N implies 
an even number of separations and each separation denotes a half-period. The 
total time covering these switching points, T, is then recorded and the quotient 
2T/N is taken as the final answer for the period of the limit cycle. Since this 
method uses the average of the periods of all limit cycles, it is intuitively more 
credible in the presence of noise and is justified to be so in the simulation results 
to be presented later. 

The noise power and signal power are defined as 

_ It' 

n rji 5 

_ It! 

y Tf-Ti ^ 

respectively, where Ti and Tf are the corresponding initial and final time in- 
stants between which the samples n{t) and y{t) are taken for integration in the 
respective equations. The noise-to-signal ratio (NSR) may be measured by 

NSR = 

The relative estimation errors at the two frequency points are defined as 

r .u • . • W G{juJc) - G{jUc) 

for the point s = jUc, relative error = — — — r , 

G[jujc) 

r , . n 1 . G(0)-G(0) 

for the point 5 = 0, relative error = — — r . 

G(0) 

The mean relative error (MRE) represents the average value of the errors in 
G(0) and G{jujc)- By varying the noise power and hence the NSR, the number of 



Gjjujc) - Gjjujc) 
G{joJc) 

m-Gjo) 

G(0) • 
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limit cycles used to produce a pre-specified mean relative error is calculated. In 
such a way, the relationship between NSR and MRE is established. In practice, 
this can be used to decide how many limit cycle periods are required to reach 
the pre-specified estimation accuracy in terms of MRE, i.e. how long the testing 
should last. 



Example 5.3.1. The proposed method is applied to a first-order plus delay 
process 



G{s) = 



-3s 



S -f 1 



The noise power is gradually increased to raise the noise-to-signal ratio. The 
results of the computations are shown in Table 5.3. It can be concluded from 
the results that 



• For the same NSR, as the number of limit cycles used increases, the relative 
errors decrease. 

• As the NSR increases, the same relative errors can be achieved if more limit 
cycles are used. 



It must be emphasized that the identification method used here serves only 
as a tool to show and verify the effectiveness of the proposed averaging method. 
The choice of method is entirely optional but the results found on the rela- 
tionship between the number of limit cycles adopted, the relative error in the 
frequency response and the noise-to-signal ratio are applicable in general to all 
relay-based identification methods. 

Consider next the situation where both noise and disturbance are present 
as shown in Figure 5.6. Apart from the white noise model n{t) encountered 
earlier, also appearing in the sensor is a constant value disturbance represented 
by w(t) = w. Owing to the extra d.c. term introduced into the output signal by 
the disturbance and the fact that its value is uncertain and may change with 
time, the static component of the output due solely to the relay bias cannot be 
separated from y{t) and hence the method described above for the estimation 
of G(0) will fail. Nevertheless, the calculation of G{juc) for the process is not 
affected since the disturbance contains no frequency content other than d.c. 
and therefore (5.34) remains applicable despite the unknown w. This can be 
verified mathematically by noting that 

Ilperiody(ty~'"'^'dt ^ 

hperiod u(t)e-J^‘*dt 
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Table 5.3. Required limit cycles vs NSR and MRE without disturbance 





Mean Relative Error 


10% 


8% 


6% 


4% 


2% 




0.0744 


3 


3 


3 


3 


11 




0.1382 


3 


3 


3 


3 


13 




0.1938 


3 


3 


3 


11 


11 


NSR 


0.2510 


3 


3 


6 


10 


22 




0.3025 


4 


4 


4 


6 


16 




0.3502 


5 


5 


12 


80 


80 




0.3968 


10 


22 


22 


74 


80 




0.4520 


33 


33 


39 


80 


80 




Minimum number of limit cycles required 



Ilperiod(y(*) - 



G{jcoc)- 



(5.36) 



In the above equation, y{t) can be replaced by its average over a number of 
periods, in much the same way as in the averaging technique illustrated earlier. 
Therefore, although a measurement of the magnitude of the disturbance is not 
available, G{jcJc) can still be deduced by using the output samples y{t). 



Example 5.3.2. Simulations are performed using the same model with transfer 
function G(s) = as in the previous example and details of the adjust- 

ment of the hysteresis level, the determination of the period of limit cycles, and 
the calculation of noise power and signal power follow precisely those stipulated 
there. The final results are given in Table 5.4. The same conclusions as in the 
previous example are obtained. 



5.4 Parasitic Relay 

To get more information on a process, identifying multiple points on the process 
frequency response from one relay test is more appealing than the use of several 
relay tests. A standard or symmetric relay can excite the process at the limit 
cycle oscillation frequency ujc as well as ScJc, 5o;c, • • • , where ojc is usually very 
close to the process critical frequency for which the process phase lag is tt. Due 
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Table 5.4. Required limit cycles vs NSR and MRE with disturbance 





Mean Relative Error 


10% 


8% 


6% 


4% 


2% 




0.0819 


3 


3 


3 


3 


3 




0.1499 


3 


3 


3 


3 


4 




0.2144 


3 


3 


3 


3 


7 


NSR 


0.2665 


3 


3 


3 


3 


9 




0.3165 


3 


3 


6 


9 


16 




0.3649 


8 


8 


8 


18 


18 




0.4076 


18 


21 


27 


27 


42 




0.4489 


28 


28 


28 


28 


28 




Minimum number of limit circle required 



to the low-pass nature of most practical processes, the signal-to-noise ratios 
at ScJc, Scjc, • • • , are too low to enable meaningful estimation of the process 
frequency response at these points. Effectively, we can only get the critical 
point information from such a relay test. By adding a bias to the relay, we 
may obtain the process static gain as well. The frequency response information 
between zero and ooc is most important for an understanding of the process 
dynamics and its use in controller design. To estimate more points around this 
region in one relay test, a modified relay is proposed in this section. 

Our modified relay consists of a standard relay and a parasitic relay as 
shown in Figure 5.7. The standard relay operates as usual with amplitude of 
the sampled output ui(k) being //i, where u\{k) is the kth sample of ui{t). It 
is well known that this relay excites process mainly at frequency cjc- In order to 
provide additionally effective excitation to the process at frequencies other than 
(jjc while maintaining the process output oscillation under such an arrangement, 
a parasitic relay with output amplitude a//i and twice the period of ui{k) is 
introduced and superimposed on ui{k). This implies that the output U 2 {k) of 
the parasitic relay flip-flops immediately when every period of oscillations in 
ui{k) is reached. The parasitic relay is realized by 
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Fig. 5.7. Modified relay feedback system 



W2(0) = a//i; 

^ U 2 {k) — —a/jii . sign{u 2 {k — 1)), if ui{k — 1) > 0 and ui{k) < 0; 

^U 2 {k) = U 2 {k — 1), otherwise. 

(5.37) 

The constant a should be large enough to sufficiently stimulate the process 
while it should also be small enough that the parasitic relay will not change 
the period of oscillation generated by the main relay by too much. According 
to extensive simulations, a is recommended to be 0.1 ~ 0.3. The output of the 
modified relay test is thus given by 

u{k) = Ui{k)+U 2 {k), 



and is sent to the process. In this way, the process is stimulated by two different 
excitations whose periods are Tc and 2Tc. The resultant process output y from 
the modified relay test is shown in Figure 5.8 and reaches a stationary oscil- 
lation of period 2Tc. Due to the two excitations in u, y consists of frequency 
components at ^ and their odd harmonics at . . . , and ? • • • ? 

respectively. Let ys and Ug be a period (2Tc) of the stationary oscillations of 
u{k) and y{k) respectively. For a linear process, the process frequency response 
can be obtained by 



G{M) - 



Jo^°ys{t)e 



1 , 2 ,..., 



(5.38) 



where 




5.4 Parasitic Relay 111 



U)i = 



{2i - 1)27t 
2^Tc 



/-0,1, 



are the basic and odd harmonic frequencies in Us and ys> Equation (5.38) can 
be implemented using the FFT algorithm as 



G(M) = 



FFTivs) 



(5.39) 



FFT{usY 

Since the method adopts spectrum analysis instead of the describing func- 
tion, it will lead to accurate process frequency response estimation. The pro- 
posed method employs the FFT only and the required computation burden is 
light. It can identify multiple points on the frequency response from a single 
relay test. Moreover, the method can easily be extended to find other points on 
the frequency response. You may fiip-fiop the parasitic relay every three or four 
periods of the main oscillations generated by the standard relay to get other 
frequency points. You may also use more than one parasitic relay in a relay test 
and find more points on the frequency response in one relay test. As discussed 
earlier, to estimate the static gain of a process, a bias has to be introduced to 
the relay input or output. 
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Fig. 5.8. Process input and output in the modified relay test 

( u, ui, U2) 



Reduction of Noise and Disturbance Effects on Estimation In a real- 
istic environment, the major concerns for any identification method are distur- 
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bance and noise. As in Section 5.3, it can be shown that our new identification 
is also unaffected by a step-like load disturbance w as shown in Figure 5.7. As to 
measurement noise in the relay test, the same anti-noise measures as presented 
in Section 5.1 for simple relays, such as the introduction of hysteresis and a 
low-pass filter, can be used for the master relay in the new scheme. To reduce 
the noise effect further, especially in the case of large noise-to-signal ratio, we 
can average several periods of the stationary oscillations to enhance estimation 
robustness; see Section 5.3 for details. With these anti-noise measures, the pro- 
posed method can reject noise very effectively, and provide accurate frequency 
response estimation at frequencies O.bcuc, and l.buJc- It should also be noted 
that a nonzero initial condition of the process at the start of a relay test has 
no effect on our estimation because only stationary oscillations Ug and ys after 
the transient are used in the estimation, where Ug and yg are independent of 
the initial condition. 

For assessment of identification accuracy, the identification error is mea- 
sured here by the worst-case error 



ERR = max 

i 



G{ju)j) - G{juji) 

G{jui) 



X 100%, i = 1,2,3 



(5.40) 



where G{jcoi) and G{juJi) are the actual and estimated process frequency re- 
sponses respectively. The process frequency responses at and are 

considered since the frequency response in these region is especially important 
to controller design. To test estimation robustness against noise, the process 
output may be corrupted by some noise and the corrupted output used for 
identification. The noise level is judged, in the context of system identification, 
by the noise-to-signal ratio, which is usually defined as 



iVi — Noise-to- Signal Power Spectrum Ratio 
mean power spectrum density of noise 
mean power spectrum density of signaV 
or 



(5.41) 



N 2 — Noise-Signal Mean Ratio 
mean(abs(noise)) 

= r-rr - — 

mean {abs{si gnal ) ) 

In order to test our method in a realistic environment, real-time relay tests were 
performed using the Dual Process Simulator KI 100 from KentRidge Instru- 
ments, Singapore. The simulator is an analogue process simulator and can be 
configured to simulate a wide range of industrial processes with different levels 
of noise and disturbance. The simulator is connected to a PC via an A/D and 
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D/A board. The window-based DT VEE 3.0 from DataTranslation is used as 
the system control platform, on which the relay control code is written in C++. 
The fastest sampling time of the VEE system is 0.06 second. A few examples 
of real-time testing are presented below. 





(c) 




(b) 




(d) 



Fig. 5.9. Estimation of frequency response with Ni = 10% noise 

(+ actual, X estimated) 



Example 5.4-1- Consider a first-order plus dead time process: 



G{s) = 



1 



55 + 1 ^ 



In our relay test, the standard relay amplitude is chosen as 0.5 and the parasitic 
relay height is set to 20% x 0.5. Without additional noise, the noise-to-signal 
ratio Ni of the inherent noise in our test environment is 0.025% {N 2 = 4%). The 
identification error ERR is 2.57%. To see noise effects, extra noise is introduced 




114 5. Relay Feedback and its Variations 

with the noise source in the Simulator. Time sequences of y{t) and u{t) in a relay 
test under Ni = 10% {N 2 = 31%) are shown in Figure 5.8, where ^ — 0 ~ 12 
is the “listening period”, in which the noise bands of y(t) and u(t) at steady 
state are measured. At this noise level, the hysteresis is chosen as 0.3. With 
averaging of four periods of stationary oscillations, the estimated frequency 
response points at this noise level are shown in Figure 5.9(a). The result is 
pretty good. At noise level Ni = 10%(A^2 = 31%), real-time testing of the 
proposed method was also performed on other typical processes whose transfer 
functions are listed in Table 5.5. Figure 5.9 compares frequency responses of 
the actual processes and their respective estimates. The identification results 
are shown to be satisfactory. 

To ensure estimation accuracy at different noise levels, the number of sta- 
tionary oscillation periods adopted in average calculation should be different. 
The estimation error ERR vs the number of stationary oscillation periods 
adopted in the averaging is plotted in Figure 5.10, which can be used cis a 
guide in deciding how many periods are needed to achieve a given estimation 
accuracy at a given noise level. Table 5.5 shows the identification accuracy of 
four real-time examples at different noise and disturbance levels. 



EHl 




Fig. 5.10. ERR vs number of stationary oscillations adopted 

- iVi = 0%, Ni = 1%, = 10%) 



In this section, a new method for process frequency response identification 
has been developed in the context of the relay feedback test. The method has 
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several unique features. Firstly, it can estimate multiple points on the process 
frequency response simultaneously with one single relay experiment and this 
reduces testing time significantly. Secondly, the method is accurate since no 
approximation is made. The computations involved are simple so that it can 
be easily implemented on microprocessors. Thirdly, the method is insensitive 
to noise and step-like load disturbances, and nonzero initial condition. Various 
processes have been employed to demonstrate the effectiveness of the method 
in real time. The identified process frequency response is useful for process 
analysis and controller design. 

Table 5.5. Identification error (ERR) 



Disturbance 


d=0 


d=0.5 


Noise 


o 

II 


1% 


10% 


10% 


II 


11% 




31% 


31% 


Processes 


ERR 


(a) 


2.57% 


5.02% 


6.83% 


7.17% 


(s+l)« 


2.93% 


5.46% 


6.90% 


6.35% 


(s+DfSi+i)*^ 


5.01% 


5.08% 


5.41% 


5.16% 


) (2s+1)2(5s+1)® 


3.55% 


5.17% 


6.38% 


5.13% 



5.5 Cascade Relay 

In the preceding section, one notes that the amplitude of the parasite relay 
cannot be chosen freely. It should be large enough to sufficiently stimulate the 
process while it should also be small enough that the parasite relay will not 
change the period of oscillation generated by the main relay by too much. Since 
the recommended value for it is small, the resultant estimation at 0.5uJc might 
be sensitive to measurement noise due to small signal-to-noise ratio there. In 
this section, cascade relay feedback is proposed as an alternative to parasitic 
feedback. The former can achieve almost the same objectives and results as the 
latter while the generation of limit cycles is less restrictive in the former than 
the latter. 

The proposed cascade relay feedback consists of a master relay in the outer 
loop and a slave relay in the inner loop, as shown in Figure 5.11. The slave relay 
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Fig. 5.11. Cascade relay feedback system 



is just a standard relay with amplitudes of the sampled output U 2 {k) being c/ 2 . 
With the inner loop closed, this relay can excite the process at the frequency Uc 
sufficiently. In order to provide additional effective excitations to the process at 
other frequencies while maintaining the process output oscillation, the master 
relay in the outer loop is introduced with its output amplitude of di and bias 
of //i, and operated at the frequency O.bcJc. It is realized by 



(-ui{k-l) + 2fj,i, 



ui{k) = < 



ui{k — 1) — 2c?i, 



[ui{k - 1), 



if ei(fc - 1) < 0 and ei{k) > 0; 
if ei(A: — 1) > 0 and ei{k) < 0; 
otherwise. 



(5.43) 



The sampled output ui (k) from the master relay is a periodic stair wave with 
three amplitudes, 2di + /xi, jui and —2di + /xi, respectively. This relay is in- 
troduced to obtain persistent excitation at frequencies of 0.5cjc and 1.5 cJc, in 
addition to cjc- In this way, the process is stimulated by two different excita- 
tions whose periods are Tc and 2Tc. The waveforms for ui, 1 x 2 , and the resultant 
output response are shown in Figure 5.12. The output reaches a stationary os- 
cillation with period 2Tc. The bias /xi is introduced to reduce possible unneces- 
sary switchings due to noise and disturbances. One can see that the difference 
between the master relay output and the process output determines the switch- 
ings in the slave relay. Since the output of the master relay has three possible 
values, 2d\ + /xi, jjli and —2di + /xi, load disturbance noise will not cause any 
relay switching unless its amplitude is larger than jii. Hence, a suitable /xi 
helps to establish robust oscillations in the process output at two fundamental 
frequencies. 

Due to the two excitations in the input, y consists of frequency components 
at ^ and ^ and their odd harmonics at . . . , and . . . , re- 

spectively. This enables process frequency response estimation at these points. 
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Fig. 5.12. Signals from cascade relay test 



The estimation formula and its implementation are given by (5.38) and (5.39), 
respectively. Moreover, the cascade relay shares the same properties of esti- 
mation robustness against noise and constant disturbances as in the master 
and parasite relay case, and can use some anti-noise measures as discussed in 
Section 5.4. 

It should be pointed out that in principle, the proposed method can be 
extended to find other points on the frequency response. One can realize the 
master relay and generate ui as a periodic stair wave which can enable y to 
have frequency components other than cjc, o;c/2, and their odd harmonics. 
Another possible way is to use more than one cascade outer loop in a relay test 
and find more points on the frequency response in one relay test. Practically, 
the information about three points on the process frequency response available 
from the proposed cascade relay method is usually adequate to represent the 
process dynamics and to tune a good controller. Although more points can be 
identified from the extension as mentioned above, the structure will inevitably 
become more complicated, leading to implementation problems. 

Guidelines for Relay Parameter Selection Most processes in industry 
are open-loop stable, and it is conjectured (Astrom and Writtenmark, 1984) 
that most of them will exhibit a stable limit cycle with standard relay feedback. 
This is also true when the proposed cascade relay feedback is used. Extensive 
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simulation shows that stationary oscillation is obtained for most processes if 
the parameters are chosen properly. We are thus motivated to consider the 
parameter selection problem for the generation of stationary oscillation in the 
cascade relay test. 

To simplify the problem and gain insight into the solution, let us consider, 
as in Section 5.2, a first-order plus dead time (FOPDT) model, 

G{s) = — (5.44) 

Lemma 5.5.1. For the cascade relay feedback system of Figure 5.11 with the 
process given by (5.44), if stationary oscillations at two different fundamental 
frequencies exist, then d 2 K > 0 and 

fii < min 1^2^, d 2 K{e^ ~ ’ (5.45) 

Proof. Refer to Figure 5.12 for the definition of t{. Consider for illustration 
that the output initial condition is > 0 smd that the slave relay switches to 
U 2 = —d 2 dit t = 0. Obviously, the other case can be proven similarly, y will 
decrease while e\ increases monotonically after a delay L. The output response 
for t > L is described by 

y{t) = 

At t = ti, y becomes 0, which causes ui to switch to 2di -f pi and U 2 to d 2 . 
Before U 2 = c ?2 takes its effect on y, the output after ti can be described by 

= (5.46) 

where t\ can be calculated from y{ti) =0, i.e.. 



as 



ii-L + rln(l + ^). 

However, y{t) will not respond to the positive switching U 2 = c ?2 until it has 
continued its monotonic downward trend for a time L, as seen from (5.46). 
At t 2 = h L, y{t) reaches its first peak in the cycle, and its value can be 
calculated from (5.46) as 



y{t 2 ) = y{ti+L) = -d 2 if(i-e-^/"). 



(5.47) 
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For t > t 2 , the output response can be described by 

y{t) = (5.48) 

The output increases monotonically. At time t = y becomes 0 and u± 
switches to fii. For ts < t < y can still be described by (5.48) and it 
keeps increasing with decreasing 62. At f = ^4, 62 becomes 0, which leads to 
the switching of U 2 to — o?2. ^4 can be calculated from the following equation: 

y{t4) = y.1, 



or 



= Hi. (5.49) 

However, y{t) will not respond to the negative switching of U 2 until it has 
continued for a time L. Therefore, at ^ — ^5 — ^4 + L, ^ reaches its second peak 
point as 

y{h) = yih + L) 

= d2K{\ - e-(<4+i-t2)/r^ 

= d2K-{d2K-ni)e~^^^. (5.50) 

The other two peaks in one cycle can be found similarly. Denote these four 
points as 

y{t 2 ) = -d 2 K{l-e-^/n, 
y{h) = d2K - {d2K - Hi)e~^/\ 
yiU) = -d2K + {d2K + Hi)e-^l\ 

y{h) = d 2 K{l - e-^/"). (5.51) 

To enable the slave relay in the inner loop to switch between two output levels 
while the master relay in the outer loop switches between the three output levels 
with two different fundamental frequencies indefinitely, the following condition 
holds: 

y{U) < 0, 



or 



Hi < d2K{e^/^ - 1 ). 

It also follows from (5.49) that 
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(I2K - lii 

d2K{2 - e-^A) 



>0, 



i.e., 



Ml < d2K. 

This completes the proof of the lemma. 

Several remarks are now made regarding this lemma. 

• The condition therein provides a guideline for choosing the bias mi to obtain 
limit cycles. Other parameters can be chosen similarly to the standard relay 
case. In practice, the relay amplitude is adjusted so that the oscillation at 
the process output is about three times the amplitude of the noise. 

• Though Lemma 5.5.1 is derived for a hysteresis-free relay, it can easily be 
extended to relays with hysteresis. 

• For a process with negative steady-state gain, ui and U 2 have to change their 
signs to attain stationary oscillations. 

• The assumption 1/0 > 0 is made only for simplicity of illustration, and can be 
removed without affecting the derivation. In fact, as can be seen from (5.51), 
2/0 has no influence on the four peaks. 



Simulation A few simulation examples are presented below, and a compari- 
son is made with the standard relay in Section 5.1 and parasite relay in Section 
5.4. The relay parameters in these three cases are chosen such that the resultant 
output oscillations have almost the same amplitudes. Performance is measured 
by the worst-case error, ERR, as defined in (5.40), and the noise-to-signal ratio 
in the form of (5.41) and (5.42) is also adopted here. 



Example 5.5.1. (Simple Dynamics) Consider a FOPDT process: 



G(s) 



1 



5s + 1® 



In our relay test, the slave relay amplitude d\ is chosen as 1, the master re- 
lay height c ?2 is set to 1, and its bias //i is 0.5. The responses are shown in 
Figure 5.13, where u is the input to the process. For multiple-point estimation 
evaluation, the parasite relay test sets its standard relay amplitude to 0.5 and 
the parasitic relay height to 0.2 x 0.5. For the standard relay test, its height is 
set to 1 and only one point Uc on the process frequency response is available 
and then used for calculating its ERR. In the noise-free case, the identification 
error ERR is 0.30% for the cascade relay test, 0.31% for the parasite relay 
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test and 11.19% for the standard relay test, respectively. Afterwards, noise is 
introduced using the band-limited white noise module in Matlab. Under this 
noise condition, hysteresis is set to 0.3 for all three relays. To reduce the noise 
effect, especially in the case of large noise-to-signal ratio, we use the average 
of the last two-four periods of oscillation as the stationary oscillation period, 
depending on the noise level. Further, the accuracy of the relay test depends 
on the reliability of judging the period of the limit cycles. To derive a more 
accurate value of the period, the averaging technique in Section 5.3 is adopted. 
With these noise rejection techniques, for A^i = 10%, ERR is 1.87% for the 
cascade relay test, 6.83% for the parasite relay and 10.01% for the relay test, 
respectively. By averaging four periods of stationary oscillations, the estimated 
frequency responses for noise levels of Ni = 10% and 20%, are shown in (a) of 
Figure 5.14 and Figure 5.15, respectively. 





Fig. 5.13. Responses obtained during various relay tests 

standard; : parasite; : cascade) 



Example 5,5,2. (Complex Dynamics) Consider now three processes having 
different dynamics: 
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Fig. 5.15. Evaluation of G{juj) for N\ = 20% 

cascade, ’x’: parasite, ’o’: standard) 



with non-minimum phase plus dead time. The actual and estimated frequency 
responses are shown in (b), (c) and (d) of Figure 5.14 and Figure 5.15, re- 
spectively. Table 5.6 shows the identification accuracy obtained under different 
relay tests with/ without noise. The identification results are seen to be satisfac- 
tory for both parasite and cascade relays. For the noisy case, one can see from 
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Table 5.6 that significant improvement is achieved by the cascade relay over 
the parasite relay for most processes. The processes used here for simulation 
are exactly the same as those in Section 5.4 and thus the results achieved with 
the cascade relay are typical and representative for the method. 



Table 5.6. Identification errors {ERR) 



Noise 
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Processes 


levels 


relays 
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g-2.5a 




5s+l 


(7+TF 


(s+l)(5s + l) 


(2s + 1)2(5s + 1) 


II 
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Cascade 


0.30% 


0.62% 


0.41% 


0.31% 


o 

II 


Parasite 


0.31% 


0.62% 


0.42% 


0.32% 


w= 0 


Standard 


11.19% 


0.53% 


7.06% 


3.71% 


o 

II 


Cascade 


1.87% 


2.76% 


5.38% 


4.39% 


(ATa = 29%) 


Parasite 


6.83% 


6.90% 


5.41% 


6.38% 


w= 0 


Standard 


10.01% 


3.70% 


10.73% 


9.37% 


Ni = 20% 


Cascade 


5.80% 


3.91% 


12.61% 


9.62% 


(ATa = 41%) 


Parasite 


14.52% 


6.12% 


14.20% 


16.96% 


w= 0 


Standard 


15.35% 


7.41% 


17.20% 


25.31% 


Ni = 10% 


Cascade 


2.01% 


4.52% 


4.93% 


4.14% 


(ATa = 29%) 


Parasite 


7.17% 


6.35% 


5.16% 


5.13% 


w= 0.5 


Standard 


17.28% 


10.08% 


36.91% 


15.31% 



All real processes have some nonlinearity. If the nonlinearity is associ- 
ated with operating point change (which is the usual case), then the proposed 
method may be applied to each operating point with a linearized model and 
gain scheduling can be used to handle this change. When the nonlinearity is 
modest, our method can be applied without any gain adaptation. 

Example 5.5.3. (Nonlinearity) Introduce a nonlinearity into a linear model 
such that the process is described by 

where v = k{u) and 
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and u is the process input. Its input and output responses u{t) and y{t) un- 
der the cascade relay test are processed as usual with the proposed method to 
give G{ju). Since the frequency response of a nonlinear process is not defined, 
the effectiveness of the proposed identification method is judged from the con- 
trol performance. For illustration, a multiple-point fitting method (Wang et 
a/., 1998a) for PID tuning is designed with the resultant G{juj). The refined 
gain and phase method (Zhuang and Atherton, 1993), which uses only the crit- 
ical point on the process frequency response available from the standard relay 
feedback test, is also applied for comparison. The resulting closed-loop response 
is shown in Figure 5.16, where the solid line is for the proposed method, and 
the dashed line is for the standard relay feedback test with Zhuang’s tuning 
method. The effectiveness of the proposed method for nonlinear processes is 
verified. 




Fig. 5.16. Control performance for 



In this section, a new relay, the cascade relay, has been proposed for robust 
estimation of process frequency response. It shows some improvement over the 
master-and-parasite relay in terms of estimation results and the likehood of 
limit cycle generation. 
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5.6 Extension to MIMO Case 

We have so far dealt with SISO processes only. We are looking for extension to 
the MIMO case. Obviously, it is too tedious and also unnecessary to consider all 
the types of relays covered so far. Instead, we will illustrate such an extension 
for the simple relays of Section 5.1 only, and extract the process frequency 
response matrix at the critical and zero frequencies. When the relay technique is 
extended to an MIMO system, there are three possible relay feedback schemes. 

• Independent Single Relay Feedback (IRF): Only one loop at a time is sub- 
jected to relay feedback while all others are kept open. 

• Sequential Relay Feedback {SRF): A loop is closed with a simple controller 
once a relay test has been made on that loop. This is repeated until all the 
loops have been tested. 

• Decentralized Relay Feedback (DRF): All loops are subjected to relay feedback 
simultaneously, as shown in Figure 5.17. 




Fig. 5.17. Decentralized relay test 



Among the three relay feedback schemes, decentralized relay feedback is 
the most desirable and will be used as our test for process frequency response 
matrix estimation in this section. Note that DRF is a complete closed-loop test, 
meaning that for an m x m plant at any instant during a test, all the m outputs 
are simultaneously under feedback control, while IRF and SRF are only partial 
closed-loop tests. For IRF, only one loop is closed, with (m — 1) open. For SRF, 
at the ith test, i loops are closed with (m — i) loops open. Closed-loop testing 
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is preferred to open-loop testing since a closed-loop test keeps outputs close 
to the set-points so that it causes less perturbation to the process and makes 
the linear model assumption (such as frequency response or transfer function) 
valid. 

Analysis of Decentralized Relay Feedback If a m x m process is con- 
trolled by decentralized relay feedback, its outputs usually oscillate in the form 
of limit cycles after an initial transient. Each output has its own oscillation 
frequency, denoted ^ = 1, 2, . . . , m, and they are, in general, different. For 
instance, a 2 x 2 process consisting of two independent (or very lightly cou- 
pled) loops has different output oscillation frequencies. However, it was found 
in Atherton (1975) that for typical coupled multivariable processes, m outputs 
normally have the same oscillation frequencies, that is, cjic = (jJ 2 c = — • = uJmc^ 
but different phases. For ease of reference later, we call this kind of multi- 
variable oscillation oscillations of a common frequency and the frequency as a 
process critical frequency, and denote it by cjc. 

The describing function method is extended in Loh and Vasnani (1994) to 
analyze multivariable oscillations under decentralized relay feedback control. 
In this context, it is assumed that the m-input and m-output process has low- 
pass characteristics in each element of its transfer function matrix and one of its 
characteristic loci has at least 180^ phase lag. Analysis of decentralized relay 
feedback based on the describing function provides a basic understanding of 
the behaviour of the resulting system and shows the effects of relay parameters 
on the behaviour so that insight and guidelines can be gained for the design 
of such relay tests. It is not intended to be comprehensive, but just to capture 
the major features of the system, as the analysis is approximate in nature. 
Therefore, for simplicity, suppose that each relay in the DRF is standard. Let 
the output amplitudes of standard relays be pi, and the inputs to the relays 
have amplitudes a^. Then, the describing function matrix of such a decentralized 
relay controller is 

N{a, p) = diag \ 

( 7T Oi 

Lemma 5.6.1. (Loh and Vasnani, 1994) • If ihe decentralized relay feedback 
system oscillates at a common frequency, then at least one of the characteristic 
loci of N{a, p)G{j(j) crosses the (— 1+jO) point on the complex plane, and the 
oscillation frequency corresponds to the frequency at which the crossing occurs. 
Further, if the process is stable, then the limit cycle oscillation is stable, the 
outermost characteristic locus of N {a, p)G{juj) passes through the (—1 + jO) 
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point and the process critical frequency is the same as the critical frequency of 
the outermost characteristic locus. 

It is noted that the crossing condition and the oscillation frequency in 
Lemma 5.6.1 are related to iV(a,/i), which cannot be calculated until the os- 
cillations are observed and the amplitudes ai of relay inputs measured from 
the oscillation waveforms. It would be useful if the frequency could be given 
in terms of the information on the process only but independent of the relay 
controller. To this end, consider an m x m multivariable process G{s) with row 
Gershgorin bands as shown in Figure 5.18. For each band, let cn = guioJn) and 
Ci 2 = be the centres of the circles which are tangential to the negative 

real axis, and {—/3n +i0) and {—I3i2 +j0) be the points at which the outer-rim 
and inter-rim of the ith. Gershgorin band intersect the negative real axis re- 
spectively. If the ith Gershgorin band does not intersect the negative real axis, 
[ujii , uji 2 ] is defined to be empty. The following result gives an estimate for ojc 
in terms of ojn and 0 Ji 2 . 







Fig. 5.18. Gershgorin bands 



Proposition 5.6.1. If the decentralized relay feedback system oscillates at a 
common frequency cjc, then there exists a k E {l,2,...,m} such that ujc ^ 
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Proof. By the Gershgorin theorem (Maciejowski, 1989), we know that the char- 
acteristic loci of G{s) lie in the union of its Gershgorin bands. The point at 
which the i-th characteristic locus Xi(juj) of G crosses the negative real axis 
if it exists can only lie in the union of circles with centres from cn to Q 2 . It 
follows that for Xi{juj), the critical frequency ujic at which the crossing occurs 
is in the range [oJn, uji 2 ]- Suppose now that the transfer function matrix G{s) 
is multiplied by a diagonal constant matrix K — diag{ki} as 



Q^KG = 



ki9i 
k>iQi 
km 9 m 



where 9 i, i = 1, . . . ,m are the row vectors of G{s). The centres of the circles 
for the ith Gershgorin band of Q have now been shifted to ki 9 u with the 
radii of the circles magnified k{ times as shown in Figure 5.19. Since ki is 
constant, the centre ki 9 u{ujii) has the same phase as that of cn = 9u{(jJii) 
and is on the straight line drawn through the origin and 9u{uJii). Further, the 
magnitude \kigu{(jOii)\ differs from \gu{uJii)\ by a factor \ki\. Therefore, the 
distance between the point kigu{ujii) and the negative real axis is \ki\ times 
as large as that between the point gu{uJii) and the axis, which is exactly the 
radius of the circle with centre kigu{ujii). This implies that this circle is still 
tangential to the negative real axis and thus ojn for Q is equal to ojn for G. The 
same can be said for Ci 2 and 0 Ji 2 = 0 Oi 2 • It follows that the critical frequency ojic 
for the ith characteristic locus of Q{s) is still in [oon^ ^ 12 ]- Since the describing 
matrix iV(a, g) is also a constant diagonal matrix, the critical frequency for the 
ith characteristic locus of N{a, g)G{s) is thus in [con, 0 Ji 2 ]. By Lemma 5.6.1, 
the limit cycle oscillation frequency must be in one of [ojh, uJi 2 ], i = 1, 2, ...,m 
and our result follows. 



In view of Lemma 5.6.1 and Proposition 5.6.1, the oscillation frequency uJc 
for a stable process depends on which characteristic locus of G{s) is moved to 
the outermost by the multiplication of the corresponding relay element describ- 
ing function Ni = In general, one can enlarge the gain Ni by increasing 
the ratios of the relay amplitudes in the ith loop to those in other loops. We 
call this outermost loop the dominant loop. It is noted that the dominant loop 
remains dominant and the critical frequency varies very little with a fairly large 




130 



5. Relay Feedback and its Variations 




Fig. 5.19. Expansion of a Gershgorin band 



change of relay amplitude ratios unless an inner characteristic locus becomes a 
new outermost. As an example, consider the following typical process (Wood 
and Berry, 1973): 



G(s) 



12.8e~^ -18.9e~^^ 

1+16. 7s 1+21S 



6.6e~'^^ -19.4e~^^ 

_l+10.9s 1+14. 4s _ 



Let /jLi and /X 2 be the relay amplitudes in loop 1 and loop 2 respectively. 
When r := ^ varies from 1 to 2 by 100%, the process always exhibits oscil- 
lations of a common frequency, and the process critical frequency ujc changes 
from 0.494 to 0.496, i.e., by 0.4%. This feature is addressed in the following 
proposition. 



Proposition 5.6.2. If the decentralized relay feedback system for a stable pro- 
cess oscillates at a common frequency and for some k, Nk > , i = 

1, 2 , . . . , m, i 7 ^ fc, then only the kth characteristic locus of N {a^ ii)G{j(jj) crosses 
the (—1 +j0) point and the oscillation frequency satisfies uJc G 00 k 2 ]- 

Proof. The conditions, Nk > ^ = 1,2, ...,m, i ^ A:, guarantee that 

the kth Gershgorin band of N{a, is the outermost among all the m 

Gershgorin bands. Since the fcth characteristic locus of N{a^fi)G{ju) is in this 
band, it is the outermost locus of N{a, fi)G{juj). It follows from Lemma 5.6.1 
that the kth characteristic locus of N{a, fi)G{juj) crosses the (—1 + jO) point 
and the oscillation frequency oJc is equal to ookc^ which is in [uki, 0 Jk 2 ]- 
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By Proposition 5.6.2, if we vary the relay amplitudes such that the re- 
sulting describing function gain matrix AT'(a,/x) still satisfies Nj^ > , 

z = l,2,...,m, then the resulting limit cycle oscillation frequency is ex- 

pected to be in the range [ujki , and thus close to the previous value if the in- 
terval [ujku ^k 2 ] is small. In general, the condition Nk > i = 1, 2, . . . , m, 

i ^ remains true if one increases the relay amplitude of the dominant loop 
or decreases one or more relay amplitudes in the other loops. 



Estimation of Process Frequency Response An m x m multivariable 
process can be described in the frequency domain as 



2/1 (iw) 



ffll(iw) ... gimijl^) 



Ui{ju) 






■ ■ ■ 5mm (jw) 



UmU^). 



(5.53) 



We want to estimate the process frequency response G{joj) at the critical os- 
cillation frequency uoc. In order to additionally identify the steady-state gain 
matrix of the process, a biased relay instead of a standard relay should be used 
in the dominant loop to make the process inputs and outputs have nonzero 
means. Thus, a test as shown in Figure 5.17 with a biased relay in the dominant 
loop and symmetric relays in the other loops is applied to the process. When 
the process becomes stationary, the process stationary inputs Ui{t) and out- 
puts yi{t), i = 1, 2, . . . ,m, are all periodic, and can be expanded into Fourier 
series. If the oscillations in m loops have a common frequency uoc, then the 
direct-current components and the first harmonics of these periodic waves are 
extracted as 





Jo‘Mt)dt 






f/i(0) := 




, yHO) := 






Jo° ’^m{t)dt_ 




Jo‘ ym{t)dt_ 



(5.54) 



U\jWc) 










Then 









(5.55) 



yi(0) = G(0)/7^(0), 



(5.56) 
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and 



Y\jujc) = G{juJc)U\ju;c). (5.57) 

Since (5.56) and (5.57) are vector equations, they are not sufficient to de- 
termine G{juJc) and G(0) from and only. Next, we slightly increase 
the relay amplitude of the dominant loop or decrease that of another loop, 
and repeat the above procedure until m tests have been completed. According 
to Proposition 5.6.2, the process is likely to have all the oscillation frequen- 
cies close to each other for the m tests. Y^{0),U^{0),Y^{jujc),U^{juJc), ..., 
Y'^{0),U'^{0),Y'^{jojc),U'^{j(jJc) are obtained subsequently. We have 

[y^O) ••• y'"(0)] = G(0)[?7^(0) ... U"^{0)], (5.58) 

and 

[yi(M) ... Y^{jujc)] = G{juJc)[U\jcjc) ... (5.59) 

While (5.58) is accurate for any decentralized relay test, (5.59) is only approx- 
imate since ojc is not exactly the same for all m tests, i = 1, 2, . . . , m, are 
linearly independent since there is always a relay amplitude change for each 
test. It follows from (5.58) and (5.59) that the steady-state gain matrix G(0) 
and frequency response matrix G{juJc) are determined, respectively, as 

G(0) = [VH0) ... y"^(0)][G^(0) ... U^{0)]-\ (5.60) 

and 

G(M) = [y^M) ... Y^ijcOc)][U\jcJc) ... U^{juc)]-K (5.61) 

Our relay experiment thus consists of m decentralized relay tests and con- 
tinues from one to another without any stop in between. To design this ex- 
periment, one needs to specify relay amplitudes for each test. The following 
design parameters are recommended for use and are obtained through our ex- 
tensive case studies. For the first test, the relay amplitude for each loop is set 
as in the single- variable case (see Section 1). In most circumstances, stationary 
oscillations of a common frequency will result in the system. For subsequent 
tests, either the relay amplitude in the dominant loop is increased or the relay 
amplitude in one of the other loops is decreased by 5-20%. This usually leads 
to oscillations with frequencies close to the previous ones. 

It should be pointed out that m decentralized relays in our test scheme are 
reasonable and even necessary to identify an m x m system. Out test scheme 
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may actually need less time than those for IRF and SRF. To see this, our 
scheme uses m non-stop relays, while both IRF and SRF also contain m relays 
for a m X m system. Furthermore, between their m relays, there are additional 
(m — 1) control transients to bring outputs back to the set-points before the 
next relays can be performed. In the context of resonance approximations, the 
number of relays should be at least m in order to identify an m x m frequency re- 
sponse matrix G{juj), as explained above. In our opinion, the main shortcoming 
of the decentralized relay test is that it may cause complicated multivariable os- 
cillations (Atherton, 1975; Loh et a/., 1993; Zhuang and Atherton, 1993), where 
three modes of multivariable oscillations have been observed. If there are no 
oscillations or the oscillations have different frequencies at different outputs, 
our method cannot be used and this is a restriction on it. However, oscillations 
with a common frequency is the mode most likely to occur (Atherton, 1975) 
when the process has significant interaction, which is the case considered in 
this section. 

Noise is an important issue in the identification problem. Like the SISO 
case, anti-noise measures such as hysteresis, low-pass filtering and multiple 
oscillation periods can also be used in the present case of a DRF for each relay. 
No further discussion is required. 



Example 5.6.1. Consider the well-known Wood/Berry binary distillation col- 
umn plant (Wood and Berry, 1973): 



G{s) = 



12.8e~^ -18.9e~^^ 
1+16. 7s 1+21S 



6.6e~'^^ 



L 1+10. 9s 



-19.4e~^^ 
1+14. 4s J 



It is a typical MIMO plant with strong interaction and significant time delays. 
For a tuning test, the relay in loop 1 is set as a symmetric relay with output 
switching levels of 1.00 and —1.00, and a relay with bias in its output giving 
switching levels 1.50 and —1.00 is used in loop 2. The system exhibits limit 
cycle oscillations having a common frequency with frequency ujI = 0.485. The 
switching levels of the relay in loop 2 is then changed to 1.80 and —1.20. 
The system exhibits limit cycle oscillations having a common frequency with 
(jjI = 0.484 in this case. The steady-state gain matrix G(0) and frequency 
response matrix G(cUc) sire computed from (5.60) and (5.61) as 



12.8 -18.9 
6.60 -19.4 



and G(jcuc) = 



1.56e-i*^2j 13 0gO.22ij 

l,2lei-46j 2.79e0-260-^' 



G(O):- 




134 5. Relay Feedback and its Variations 



where uOc=\{ool They are very accurate, compared with their true 

values: 



G(0) = 



12.8 -18.9 
6.6 -19.4 



and G(0.485j) - 



1.57e-i-^^-^' 18.5e^-2i^' 
1.23e^-^^-^‘ 2.75e^-26j 



Example 5.6.2. Consider the process in Palmor et al (1993): 



G(.) 



(0.1s+l)2(0.2s+l)2 (0.1s+l)(0.2s+l)2 

1 2A 

_ (0.1s+l)(0.2s+l)2 (0.1s+l)(0.2s+l)2(0.5s+l) _ 



There are large interactions in this process. Two decentralized relay tests are 
performed on it. The relay in loop 1 is symmetric with unit switching levels, and 
the switching levels of the relay in loop 2 are 1.40 and —0.933 in the first test 
and changed to 1.50 and —1.00 in the second. Both tests result in limit cycle 
oscillations with the same frequency uJc = 4.29. The estimated steady-state 
gain matrix G(0) and frequency response matrix G{juJc) are 



G(0) = 



0.500 -1.00 
1.00 2.40 



G(4.29j) = 



0.243e-2-25j 0.529ei'3i-^‘ 
0.529e-i-^^-^' 0.537e-2*9«-^' 



while the true values are 



G(0) = 



0.5 -1 
1 2.4 



G(4.29j) 



0.24e-2'23j o.53ei-22j 

0.53e-i-^2-^' 0.54e~2-^^-?' 



In this section, multivariable oscillations under decentralized relay feedback 
control have been investigated. In particular, it is shown that for a stable mxm 
process, the oscillation frequencies remain almost unchanged under relatively 
large relay amplitude variations. Therefore, if m decentralized relay feedback 
tests are performed on the process, their oscillation frequencies are close to 
each other so that the process frequency response matrix can be estimated at 
that frequency. A bias may be introduced into the relay to additionally obtain 
the process steady-state matrix. 
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In the preceding chapter, relay feedback has been employed to identify the 
process frequency response. It is, however, noted that the frequency response is 
obtained only at a few discrete frequency points. Essentially, only one point, the 
critical point on the process frequency response, is estimated from a symmetric 
relay test, and a few other points can also be estimated at the expense of 
possibly a longer testing time and a more complicated relay, such as biased, 
parasite or cascade relay. Fundamentally, this is because only the steady-state 
response, i.e., the limit cycle, is exploited for identification and this contains 
spectral information on the oscillation frequency and its higher harmonics only, 
and harmonics at high frequencies are practically not identifiable due to the 
low-pass nature of most process dynamics. Note that the transient responses 
of the process input and output are ignored although they are also available 
from a relay test and contain rich spectral information of the process. As a 
result, one can expect that use of the relay transient response in identification 
will produce more process information than an approach based solely on the 
steady-state response. To do so, time domain based least squares techniques 
may be utilized and good books on this topic are readily available (Ljung and 
Soderstrom, 1983), which is thus not pursued here. Instead, the goal of the 
present chapter is to show how to estimate the process frequency response 
from the system transient responses to a single and simple relay test. The main 
tool used is the fast Fourier transform (FFT). We demonstrate that direct 
application of the FFT to relay feedback system signals gives false results, and 
signal decomposition and weighting are necessary to yield correct results. 



6.1 Signal Analysis 



With a computer monitoring and control system in place, the signals collected 
from a process test such as a relay test are all discrete time. For spectrum 
analysis of discrete time signals, the discrete Fourier transform (DFT) may be 
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used and the fast Fourier transform (FFT) is an efficient and reliable method 
for computing the DFT. Since the FFT can be applied to arbitrarily windowed 
signals, it seems possible to obtain the process frequency response by taking 
the FFT of the process input and output directly. However, this idea is shown 
in this section to be false, and the remedy to this failure is highlighted. 






Relay 



Process 



Fig. 6.1. Relay feedback system 



Consider a SISO relay feedback system, depicted in Figure 6.1, where the 
process is a LTI system with the transfer function G(s), and the relay can be any 
type, but preferred for simplicity to be a symmetric one with nonzero hysteresis 
as an anti-noise measure and with bias if static gain estimation is extremely 
important. Suppose that the process is at rest, i.e., has zero initial conditions, 
and then a chosen relay feedback is applied to the process ai t = 0. Assume 
that the relay feedback system is stable and yields limit cycle oscillations as 
its steady state. The resultant process output response y{t) and input response 
u{t) are sampled as y{kT) and u{kT) with the sampling interval T, respectively. 
Our task is to identify the process frequency response, G{ju), from the recorded 
samples, y{kT) and u{kT)^ fc = 1, 2, • • • . 

Let T{x(t)] represent the Fourier transform of x(t). Intuitively, estimation 
of the process frequency response, G{joj), seems straightforward, and could be 



G{juj) ^ 



Y{ju:) _ ny{t)} 



U{ju) J^{u{t)Y 

This may be approximated by applying the FFT to y{kT) and u{kT), k 



= UM ~ T-J^:FT{y{kT)} 

’ U{joj) ~ T • J^J^T{u{kT)} ■ 

Unfortunately, it is wrong. 



( 6 . 1 ) 
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Fig. 6.2. Signals under relay feedback control 

To determine the bugs in the formula, mathematically, y{t) and u{t) can 
be decomposed into the periodic stationary cycle parts ys{t) or Us{t) and the 
transient parts Ay{t) or Au{t) as 



y{t) = Ay{t)+ys{t) 


(6.2) 


u{t) — Au(t) + Us{t), 


(6.3) 



as exhibited in Figure 6.2. Practically, when noise is not significant, the last 
stationary oscillation period of y{t) and u{t) are copied backwards to generate 
periodic stationary cycle parts ys{t) or Us{t), and Ay{t) and Au{t) are obtained 
by taking respective differences between the overall and stationary responses. 
Obviously, the transients parts, Ay{t) and Au{t)^ decay to zero at steady state. 
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Thus, they are absolutely integrable and Fourier transformable. We obtain their 
Fourier transforms 

AY{joo) = T{Ay{t)}, and AU{ju) - T{Au{t)]. (6.4) 

The FFT of a discrete signal, x{kT), = — 1, where N is an 

even integer, is defined by 
N-l 

J^J^T{x{kT)} := , / = 1, 2, • • • , M, (6.5) 

k=0 

where M = ^ ^nd uji = 27 tI/{NT). Suppose that the signal x{t) decays to zero 
as time approaches infinity and it is a one-side signal, i.e., x{t) = 0, if ^ < 0; 
and 0 if t > T/. If the FFT window is bigger than T/, the FFT of the 

corresponding discrete decaying signal will give the scaled Fourier transform of 
x{t) at discrete frequencies as 

poo pTf 

X{j(jj) — / x{t)e~^^^dt ^ / x{kT)e~^^^'^ 

Jo Jo 

N-l 

x{kT)e-^‘^'^^ = T ■ J^J^T{x{kT)}, (6.6) 

k=0 

where N is an integer such that (iV - 1)T = T/. Equation (6.6) when applied 
to (6.4) implies 

AY{juj) « T^TJ^T{Ay{kT)}, (6.7) 

and 

AU{juj) « T‘J^J^T{Au{kT)}, (6.8) 

that is, the FFT of the transient’s part Ay or Au from the relay test is ap- 

proximate to its scaled Fourier transform. This fact is very important in FFT 
applications. 

Strictly speaking, the Fourier transform of the periodic parts ys{t) and Us{t) 
actually does not exist since they are not decaying signals and thus not abso- 
lutely integrable, and are unable to yield the corresponding frequency response, 
Ys{juj) and Us(joo) as required in (6.1) together with (6.4). Nevertheless, taking 
the FFT of a periodic signal is a very common operation in signal processing. 
For a double-sided periodic signal x{t) with a period Tc-> its Fourier transform 
(Morrison, 1994) is 

oo 

X{uj) = 2 tt ^ CnS{uj — n(jOc), 



n= — oo 



(6.9) 
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where Uc = S{uj — nujc) is the Dirac delta or unit impulse, and Cn are the 
coefficients of the Fourier series of x{t) given by 

Cn = ^ r° « ^TTT{x{kT)}, (6.10) 

J-C JQ J-C 

where the FFT is taken over a period of x(^), indicating that the FFT of one 
period of the sampled x{t) gives but not X{juj) as desired. 

To see what is wrong with (6.1), we apply (6.9) and (6.10) to the periodic 
parts ys{t) and Us{t) and compare the results with (6.7) and (6.8). It is true that 
the FFT of the transient parts Ay and Au do arrive at their respective scaled 
Fourier transforms. However, the FFT of one period (or multiple periods) of the 
periodic part ys or Ug will actually give the scaled amplitudes of impulses in its 
Fourier transform, or the coefficients of their Fourier series. Two FFT results 
have different meanings. Summing them together does not have any practical 
sense and will not produce the correct process frequency response. Therefore, 
directly applying the FFT to the process output and input and calculating the 
process frequency response by (6.1) is meaningless and will definitely lead to a 
wrong result. 

Since the FFT of the transient part Ay or Au gives its scaled Fourier 
transform and the FFT of one period of the periodic part ys or Us will actually 
give the scaled amplitudes of impulses in its Fourier transform, one may think 
that the process frequency response might be obtained by 

re ) = ^ r • J^J^T[Ay{kT)] + 27 T Er=-oc - nue) 

T • J^TT[Au{kT)] + 27t Er=-oo UsnS{uj - noj,) 

( 6 . 11 ) 

where Ysn and Usn are the coefficients of the Fourier series of ys and Ug re- 
spectively. However, this makes use of (6.9), which assumes that the signal is 
two-sided, while ys and Ug from a relay feedback test are one-side signals. For 
a one-side periodic signal which we have at hand, its Fourier transform usually 
contains two parts. One is obtained by simply setting s = joo in its Laplace 
transform while the other is a series of impulses at the singularity frequencies 
of the Laplace transform (McGillem and Cooper, 1984). If what one is inter- 
ested in is the Fourier transform at frequencies other than these singularity 
frequencies, the Fourier transform is determined by the first part only and can 
be obtained from its Laplace transform with the simple substitution s = juj. 
For this purpose, we have to make use of the following lemma. 

Lemma 6.1.1. (Kuhfitting, 1978). Suppose that x(t) is a periodic function 
with period Tc for t >0, i.e., 
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I x(t -f Tc), t e [0, -f oo), 
x(t) = ^ 

0, t e (-00,0). 

Assume that the Laplace transform, L{x{t)} = X{s), exists. Then, 

= 1 _ l-sT. x{t)e-^*dt. (6.12) 

It follows that the corresponding Fourier transform at frequencies other than 
the singularity frequencies, oo = mojc = m = 0, 1, 2, • • • , can be obtained 
as 

X(juj) = ^ x{t)e~^‘^*dt. (6.13) 

Based on the above observations, two numerical techniques for multiple-point 
frequency response estimation from a single relay feedback test will be presented 
in the subsequent two sections. 



6.2 Decomposition Method 



The transfer function of a linear process is given by 



G{s) = 



Y{s) 

UisY 



Laplace-transforming (6.2) and (6.3) gives 



U{s) AU{s) + Us{s)' 



(6.14) 



where AY{s) and AU{s) are the Laplace transforms of the transient parts 
Ay{t) and Au{t) respectively, Ys{s) and Us{s) are the Laplace transforms of 
the periodic parts ys{t) and Us{t) respectively. By Lemma 6.1, (6.14) becomes 

G(.) = (e,5, 

AU{s) + /o ' Us{t)e-^^dt 

where Tc is the period of the process output stationary oscillation from the 
relay feedback test. Setting 5 = jcj, (6.15) becomes 



G{juj) = 



^Yjjuj) + ys{t)e-^‘^*dt 

AU{ju) + Us{t)e-i‘^*dt 



(6.16) 
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We wish to have a numerical scheme for computing (6.15) for practical appli- 
cations. Suppose that at ^ = T/, y{t) and u{t) have nearly entered stationary 
oscillation status and after t = Tf, both Ay{t) and Au{t) are approximately 
zero. Let N be an integer such that {N — 1)T ^ Tf. As discussed before, the 
Fourier transform of Ay{t) is approximated by 

poo pTf 

AY{juj)= / Ay{t)e~^^^dt ^ / Ay{t)e~^^^dt 
Jo Jo 



N-l 

= T-J^J^T{Ay{kT)}, (6.17) 

k=0 

where / = 1, 2, • • • , M, M = — and ou = uji = 27:1/ (NT). 

Ys{ju)) at discrete frequencies uji is computed using the digital integral: 



Nc 



= I _ e-MT. E ys{kT)e~i'^'^'^ , Z = 1, 2, • • • , M, 



(6.18) 



k=0 



where M and oji are defined as before, and the integer Nc « {Tc — T)/T, i.e., 
the summation is taken over one period. AU (juji) and Us{joj) can be calculated 
in the same way. Consequently, the process frequency response is obtained as 

TJ^T{Ay{kT)} + Ef=o ysikT)e~^‘^‘>^^ 



Gijuji) = 



J^J^T{Au(kT)} + Eto Us(kT)e-Mi^T ’ 

/ 1,2,- - ,M. 



(6.19) 



This method employs the FFT and digital integration only. The required com- 
putation burden is thus modest. It can identify multiple points on a frequency 
response from a single relay test. It is accurate in the absence of noise and 
disturbance. 

For real implementation of (6.19), we must give values for the time span 
Tf = {N — 1)T required in the FFT computations (6.17). It turns out that Tf 
or N is related to the number of the frequency response points to be identi- 
fied. Suppose that the number of the frequency response points to be identified 
from zero frequency to the process phase-crossover frequency Uc is M, where 
M is specified by the user. It follows from (6.17) that the M frequency re- 
sponse points recovered by the FFT method are at the discrete frequencies 
0, Auj, 2A(jj, • • • , (M — l)Z\o;, where Aoj = oji^i —oui = 27: /NT is the frequency 
increment. The definition of M means that ojc ^ {M — l)Auj and 






UJ. 






( 6 . 20 ) 
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On the other hand, one can measure the oscillation period Tc on line when a 
relay test is performed and ojc can be estimated as 




( 6 . 21 ) 



Equations (6.20) and (6.21) yield 



iV«(M-l)p (6.22) 

where M should be specified a priori and be large enough to ensure that the 
stationary oscillation is reached. Then, N is determined from (6.22) and the 
corresponding time span is obtained a.s Tf = {N — 1)T. 

Different identification methods are more or less sensitive to noise. It is ap- 
parent (Ljung and Soderstrdm, 1983) that in almost all identification methods 
a low noise-to-signal ratio is required. Regarding measurement noise in the re- 
lay test, Astrom and Hagglund (19846) pointed out that hysteresis in the relay 
is a simple way of reducing the influence of measurement noise. The hysteresis 
width should be bigger than the noise band (Astrom and Hagglund, 1988) and 
is usually chosen as twice the noise band (Hang et a/., 19936). Filtering is an- 
other possibility (Astrom and Hagglund, 19846). Measurement noise is usually 
of high frequency, while the process frequency response of interest for control 
analysis and design is usually in the low-frequency region. In particular, the 
process frequency response in [0, cOc] is critical for controller design. We found 
in our experiments that the measurement noise is in a fairly high frequency 
region. Therefore, a low-pass filter can be employed to reduce the measure- 
ment noise. The cut-off frequency of the filter is determined with respect to the 
process frequency region of interest. A possible choice is SuJc ~ To reduce 
the effect of noise further, especially in the case of large noise-to-signal ratio, 
one may also use the average of the last four or five periods of oscillation as the 
stationary oscillation period and copy this average period backwards to obtain 
Ps. With the above three anti-noise measures, the proposed method can reject 
noise quite effectively. 

When a relay feedback test is to be conducted, the process is first brought to 
the operating point before relay feedback tests start. After the process reaches 
a steady state, a ‘listening period’ (10-20 samples) begins. During this period, 
the steady state of the process input and output are measured. To prevent 
relay switching at the wrong instants, relay hysteresis is usually adopted. In 
the ‘listening period’, the peak value of noise is monitored, from which the 
hysteresis of the relay is determined. Usually, the hysteresis is chosen to be 
twice the peak value of the noise. After the ‘listening period’, the relay feedback 
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test is launched. The process input and output are sampled until the system 
reaches a stationary oscillation. The stationary oscillation can be detected by 
monitoring the relay output oscillation periods. 

For the assessment of identification accuracy, identification error is here 
measured by the worst-case error 



ERR = max 

i 



Gjjuji) - G{ju>i) 
G(juJi) 



X 100%, 



1 = 1 , 2 ,- 



,M 



(6.23) 



where G{ju)i) and G{ju>i) are the actual and the estimated process frequency 
responses respectively. The Nyquist curve for phase ranging from 0 to — tt is 
considered since this part is most significant for control design. To test estima- 
tion robustness against noise, the process output may be corrupted by noise 
and the corrupted output used for identification. The noise level is judged, 
in the context of system identification, by the noise-to-signal ratio, which is 
usually defined as 



Ni = Noise-to-Signal Power Spectrum Ratio 



mean power spectrum density of noise 
mean power spectrum density of signal ’ 
or 



N 2 = Noise-Signal Mean Ratio == 



mean (abs (noise)) 
mean (abs (signal)) * 



Example 6.2.1. Consider a high-order plus dead time process: 



G{s) 



(S + 1)5- 



(6.24) 



(6.25) 



Relay feedback is applied to it and y{t) and u{t) are logged and then decom- 
posed into y = Ay -h ys and u = Au -h Ug as in (6.2) and (6.3). With 1000 
samples per stationary cycle period and M = 15, the process frequency re- 
sponse is identified using (6.19) and is shown in Figure 6.3. The ERR is 0.32%. 

In order to test our method in a realistic environment, real-time relay tests 
were performed using the KI 1 00 Dual Process Simulator from KentRidge In- 
struments, Singapore, as shown in Figure 6.4. The simulator is an analogue 
process simulator and can be configured to simulate a wide range of industrial 
processes with different levels of noise. The simulator is connected to a PC via 
an A/D and D/A board. The window-based DT VEE 3.0 is used as the sys- 
tem control platform, on which the relay control code is written in C++. The 
fastest sampling time of the VEE system is 0.06 s. It follows from our extensive 
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Fig. 6.3. Process Nyquist plot ( actual, +estimated) 




Fig. 6.4. Relay feedback system in the presence of noise 

tests that 200-300 samples per stationary cycle during the relay test are good 
enough for identification and control design. 

The filter in Figure 6.4 is selected as a Butterworth low-pass filter with 
cut-off frequency ScOc ~ Other anti- noise actions discussed earlier are also 
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Fig. 6.5. Real-time signals under relay feedback control 



taken. Without additional noise, the noise-to-signal ratio of the inherent 
noise in our test environment is 0.06% {N 2 = 2%). 



Example 6.2.2. Consider a first-order plus dead time process: 



G(s) = 






55 + 1 



The identification error ERR is 5.41%. To see the effects of noise, extra noise is 
introduced with the noise source in the simulator. The time sequences of y(t) 
and u{t) in a relay test for Ni = 10%(A^2 — 35%) are shown in Figure 6.5. The 
first part of the test in Figure 6.5 = 0 ~ 30) is the “listening period”, in 

which the noise bands of y{t) and u(t) are measured at steady state. 

The testing was also carried out for a variety of dynamics available on the 
simulator. The typical results are summarized in Table 6.1 with different noise 
levels. Estimation of process frequency response is generally good. It can be 
seen that our decomposition method can obtain multiple points on the process 
frequency response points simultaneously with one single relay experiment, and 
this greatly saves testing time. The method is accurate, especially in the critical 
frequency range [0,o;c], provided that the process is linear and no disturbance 
exists. The computations are simple, and easily implemented on microproces- 



sors. 
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Table 6.1. Identification error {ERR) for decomposition method 



Processes 


Noise Levels 




Ni=\% 


6% 


10% 




iV2=13% 


25% 


35% 


1 ^-53 

5s + l^ 


10.14% 


12.79% 


13.57% 


1 

{7+TF 


9.48% 


12.46% 


15.18% 


1 


6.74% 


7.98% 


8.17% 


(25 + 1)4(56 + 1)^ 


2.32% 


6.00% 


8.62% 



6.3 Weighting Method 

As revealed in Section 6.1, the signals in a relay feedback system are not directly 
Fourier transformable to obtain the process frequency response. The decompo- 
sition method in the preceding section decomposes the signals into the transient 
part and the stationary cycle parts. These parts are then transformed to their 
frequency responses using the DFT and digital integration respectively. An al- 
ternative way is to put a decay weighting on the signals such that the weighted 
signals do die off as time passes. 

Let y[t) and u{t) be the process output and input responses in a relay 
feedback system, respectively. A decay exponential e~^^{a > 0) is introduced 
to moderate them: 



= y(t)e 


(6.26) 


u{t) = 


(6.27) 



so that y{t) and u{t) decay to zero exponentially as t approaches infinity and 
become Fourier transformable. Applying the Fourier transform to (6.26) and 
(6.27) yields 

pOO pOO 

Y{juj) = / = Y{juj+a), (6.28) 

Jo Jo 

and 

poo poo 

U{joj)= / u{t)e~^^^dt— / u{i)e~^^e~^'^^dt — U{J(jj-\-a). 

Jo Jo 



(6.29) 
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The integral intervals in (6.28) and (6.29) are infinite, and digital computation 
of infinite interval integration is not trivial. However, due to the introduction of 
the decay exponential y{t) and u{t) are approximately zero after a certain 
time. The infinite interval integration problem then becomes a finite integration 
one. Thus, Y {juo) can be computed at discrete frequencies, using the standard 
FFT technique. Suppose that y{kT),k = 0, 1, 2, • • • , W — 1, are samples of 
y{t), where T is the sampling interval. N is chosen such that y{{N — 1)T) has 
reached a stationary oscillation, and the decay coefficient a is selected such 
that y{{N — 1)T) formed from (6.26) has approximately decayed to zero. Then, 
we have 

Y{juji) w [ ' ^ I] = T ■ TTT{mT)}, 

k=0 

l = (6.30) 

where Tf is the time when y{Tf) = y{NT-T) « 0, M = y and wj = 2ttI/(NT). 
U{jui) can be similarly computed by taking the FFT of u{kT). Therefore, the 
shifted process frequency response G{ju)i + a) is obtained as 



G{jui+a) = 



Y{jui + a) ^ TTT{y{kT)} 
U{j<^i + a) TTT{u{kT)Y 



1 = 1,2,- - ,M. 



(6.31) 



The identified shifted process frequency response may be directly used for pro- 
cess modelling and controller design. However, if G{jcj) rather than G{juj + a) 
is needed, one can first take the inverse FFT of G{juii + a) as 



g{kT) := J^TT-\G{juJiYa)) = g{kT)e~'^’^'^ , / = 1, 2, • • • , M. (6.32) 



It then follows that the process impulse response g{kT) is 

g{kT) = g{kT)e^>‘^. (6.33) 

Applying the FFT again to g{kT) would result in the original process frequency 
response 



G{M) = TTT{g{kT)). (6.34) 

For implementation of (6.31), values must be assigned to the decay factor a 
and the time span Tf — {N — 1)T required in the FFT computations (6.30). 
Consider first the selection of T/. Following a similar argument to that in the 
preceding section on T/, we also reach (6.22) and for easy reference we repeat 

AT«(M-l)^ 



( 6 . 22 ) 
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where M should be specified a priori, and should be large enough to ensure that 
the stationary oscillation is reached. Then, N is determined from (6.22) and 
the corresponding time span is obtained a>s Tf = {N — 1)T. Practically, if M 
is large, the computational load increases, but the points in a small frequency 
range may not necessarily give additional information on the process dynamics. 
The number of frequency response points M is usually selected to be around 
10-20. To cover the entire transients of y{t) and u{t) with such an M, the 
process inputs and outputs samples may be screened, or one taken from a few, 
equivalently making a bigger T. 

The value of the decay coefficient a should be such that y{t) and u{t) decay 
nearly to zero when the time approaches T/, regardless of the nonzero y{t) 
and u(t). It is this decay coefficient a that enables the infinite integral of the 
Fourier transform to be replaced by the finite digital integral of the FFT. To 
make (6.30) a good approximation, the decay coefficient a should satisfy 

^-oiTf ^ ^ ( 6 . 35 ) 



or 



a > 



Ins 



(6.36) 



where s is the specified threshold, and usually takes a value of 10“^^ ~ 10“^. 
On the other hand, a should not be too large, better kept a less than 0. 1-0.2 
to prevent losing too much information when forming y{t) and u{t). 

For noisy data, all the anti-noise measures discussed in Section 6.2 are also 
applicable to this weighting method. The identification error EER as defined 
in (6.23) is used for assessment of the estimation accuracy. 



Example 6.3.1. This example is adopted from Li et al. (1991): 






o-2s 



105 + 1 



The model estimated by Li et al. (1991) is 



G(5)^ 



0.988e-2" 
8.025 + 1 ’ 



and its identification error is ERR = 22.32%. In Li’s method, the dead time is 
assumed to be known. For our weighting method, relay feedback is applied to 
the process. The process output and input are logged. y{t) and y{t) of the relay 
test are shown in Figure 6.6(a), while u{t) and u{t) are given in Figure 6.6(b). 
The frequency response identified is shown in Figure 6.7. The ERR is 0.26%. 
This indicates that the proposed method provides a much more accurate result. 
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(a) 



1 
0 
-1 

0 20 40 60 

(b) 

Fig. 6.6. Signals under relay feedback control 

Example 6.3.2. In order to test the method in a realistic environment, real- 
time relay tests were also performed on the KI 100 Dual Process Simulator. 
The description of this process simulator and its experimental set-up for iden- 
tification has been given in the preceding section. The same low-pass filter and 
other anti-noise actions as discussed in Example 6.2 were also taken. Table 6.2 
presents the identification results of four typical examples at different noise lev- 
els. The accuracy is satisfactory. This weighting method yields slightly better 
estimation results, compared with the decomposition method. 




6.4 Testing on Pilot Plants 

In the preceding two sections, we have presented two methods for identifying 
multiple points on the process frequency response with one single relay feedback 
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Fig. 6.7. Nyquist plot of G{ju) ( — actual, +estimated) 
Table 6.2. Identification error (ERR) for weighting method 



Processes 


Noise levels 


Ni=l% 


6% 


10% 


N2=13% 


25% 


35% 


1 ^-53 

5s + l ^ 


6.14% 


7.96% 


9.67% 


1 

(s+l)» 


7.42% 


8.97% 


9.85% 




3.75% 


6.52% 


8.65% 


(2s + 1)4(5s+1)^ 


2.93% 


4.48% 


8.69% 



experiment, and demonstrated their effectiveness by numerical simulation and 
real-time implementation on an analogue simulator. In this section, we test 
them on real plants. Since the two methods produce similar results, we will 
show only one method, the weighting method, for illustration. An essential 
difference between this physical test and the previous ones is that for a real plant 
no true frequency response is available to assess our identification results. In the 
context of control engineering, process identification is ultimately for process 
control. Control performance can easily be measured. Thus, we shall, in this 




6.4 Testing on Pilot Plants 151 



section, combine our identification method with some simple PID controller 
tuning methods to form an auto-tuner and then compare the resultant control 
performance with the standard relay auto-tuner for PID controllers, to see if 
an improvement can be achieved with the new technique. 

These multiple points on the process Nyquist curve can be used to tune a 
better PID controller, compared with those using the critical information only. 
Systematic techniques for the design of various controllers are covered in detail 
in Part III of this book. For this section, we present only a simple PID tuning 
method. 

Consider a conventional negative feedback control system with a given pro- 
cess G{s) and controller K{s). The controller is to be designed such that the 
actual closed-loop transfer function is best fitted to the objective closed-loop 
transfer function H from r to y. The objective open-loop frequency response 
profile can be properly selected according to the user’s requirements, such as 
gain and phase margins, bandwidth, robustness, etc. One simple solution is to 
choose H as 



H = 






r. — LS 



+ 2Cw„s + 



(6.37) 



where L is the apparent dead time of the process that can be read off from the 
relay test, and ^ dominate the behaviour of the desired closed-loop response. 

We must give values for the objective damping rate ^ and natural frequency 
ojn in (6.37). If the control specifications are given in terms of the phase margin 
(fm and gain margin Am, the C and in H are approximately determined 
(Wang et al., 1996) by 



c = 



1 - COS^ ipm 
4 COS ipm 



tan 

— ’ 

where p is the positive root of equation 

(A„-1)2=4CV + (1-pY- 



In general, we choose relatively large gain and phase margins for fast loops and 
choose small ones for slow loops. The default settings for the parameter ^ and 
UnL are ( = 0.707 and ujnL = 2, where the corresponding phase margin is 60"^ 
and gain margin is 2.2. 
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With H determined, the open-loop transfer function Q corresponding to the 
desired closed-loop transfer function H, 



can be obtained as 

The controller K is designed such that the actual GK is fitted to the desired 
transfer function Q in the frequency domain as well as possible. This is achieved 
by minimizing the cost function: 






with respect to K, where M is chosen such that um is slightly greater than the 
critical frequency of Q. With G and Q given, a solution for K is obtained by 
its structure selection and parameter calculation. As the majority of regulators 
used in industry are of PID type, a controller having PID structure is considered 
here. For a PID controller in the form 



K{s) — Kc{l + — — \-Tds), 

us 

the least squares solution to (6.38) is 



(6.39) 



where 



Re{^) 

Im{^) 



Re{0) 

Im{Q) 



G'(M) ^ MG(M) 

G{ju^2) ^ ju^2G{jUJ2) 



QUU 

Q{j^2) 



G{3(jJm) 



j0JMG{ju!M) _ 



_Q{3'^m) _ 



[K* ^ 
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Note that the above development computes PID settings from G{joj). How- 
ever, by replacing juj with juj H- a in (6.38), a PID controller can also be calcu- 
lated using the same frequency response fitting idea from G{juj + a), which is 
the early result of the weighting method in Section 6.3, so that the conversion 
G{j(j + a) to G{juj) is unnecessary for this PID tuning. 

The multiple-point identification and multiple-point PID fitting design have 
thus been married together to form a new relay auto- tuner. The implemented 
tuner was tested on a number of physical plants and its performance (solid line 
in the figures to come) is compared with the standard relay tuner (dotted line) 
(Astrom and Hagglund, 1995). 



Output (V) 
4 




500 

Time (s) 



Fig. 6.8. Process and subsequent performance 



Example 6.4- 1- (Dual Simulator) It is interesting and useful to test our 
tuner on the Dual Simulator as described in Section 6.2 for simple verification 
of the results, as we know everything about it. Besides the test environment 
noise, extra noise was introduced with the noise source in the Simulator to see 
the effect of noise. This was in form of pseudo- white noise generated using the 
random number generator, and was inserted in the process output to act as 
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measurement noise. The noise peak value was set on the simulator to be 50% 
of the relay signal amplitude, which is 0.5U. This is equivalent to a noise-to- 
signal power spectrum ratio about 10-20%. For illustration, the simulator is 
configured into a first-order plus dead time process 
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Fig. 6.9. Process frequency response G{juj -h a) 

The complete auto-tuning process and subsequent control performance are 
shown in Figure 6.8. The process was in the steady state of 2.5U before the relay 
feedback test began. The resultant input and output transients were sampled 
and the multiple points on the process frequency response estimated by the 
identification method in Section 6.3. Figure 6.9 shows the estimated process 
frequency responses from real-time tests with and without additional 

noise. 

The apparent dead time L in (6.37) was estimated as 4.877, which was 
quite close to the real value of 5. With defaults of C = 0.707 and uJnL = 2, 
the PID controller in (6.39) was tuned to Kc = 0.6738, Ti = 6.1099 and Td = 
0.3941 using (6.40). The PID control was then commissioned and the system 
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Fig. 6.10. Auto-tuner performance for Gp{s) = 

settled down. The auto-tuning process was thus completed. The standard relay 
tuner gave PID controller parameters Kc = 0.5699, Ti = 11.6287 and Td = 
2.9072. To see the closed-loop performance, a set-point change of IV and a 
load disturbance of 0.5V were introduced afterwards. The control performance 
of the new auto-tuner (faster) and standard relay tuner (slower) are shown 
in Figure 6.10. It is observed that the response of the proposed auto-tuner 
is excellent. The performance under standard relay control is acceptable but 
shows a sluggish response. 

Example 6.4-2. (Coupled Tank) Fluid level control is popular in the process 
industry. It aims at keeping the fluid level at a user-deflned value in storage 
tanks, chemical blending and reaction vessels. Normally, the dynamics of fluid 
level systems is relatively long. For a single tank, although nonlinearity exists 
in this process, it can be approximated by a first-order linear process around 
the operating point. However, things become complex when multiple tanks are 
linked together. The water level in multiple storage tanks, in which one tank’s 
output is another tank’s input, shows a high-order dynamics. The proposed 
relay tuner was tested using the coupled tank system shown in Figure 6.11. 
The schematic diagram of the coupled tank is shown in Figure 6.12. The inflow 
(control input) is supplied by a variable speed pump which pumps water into 
Tank 1 through a long tube. Tank 1 and Tank 2 are coupled to each other 
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Fig. 6.11. Coupled-tank water level control system 



Signal Conditioning 
circuit 




Fig. 6.12. Schematic diagram of coupled tank 



through an orifice at the bottom of the tanks. In the test, the water level 
in Tank 2 was controlled by regulating the drive voltage to the pump. The 
performance of the coupled tank under the proposed tuner control is shown in 
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Figure 6.13, in which the process response under standard relay tuner control 
is also presented. The proposed tuner gives better closed-loop responses. 



Level (V) 




Fig. 6.13. Auto-tuner performance for coupled-tank level control 



Example 6.4-3. (Heat Exchanger) A heat exchanger is a common installa- 
tion in industry, where heat generated from one process is used in other part of 
the plant. Heat exchanger applications can be found in oil refineries, chemical 
processing plants, and in heating and cooling systems for buildings. Many differ- 
ent types of heat exchanger are available and the shell-and-tube heat exchanger 
is one of the most common. The pilot-scale shell-and-tube heat exchanger, 
shown in Figure 6.14 is used as a test bed. Figure 6.15 shows the schematic 
diagram of the heat exchanger. The heat exchanger is a steam-heated system 
in which water flows inside the tubes surrounded by steam flowing through 
the shell. Steam is generated by a relay-controlled steam generator. The out- 
let hot water is subsequently collected in a level-controlled tank. The flow of 
cold water into the heat exchanger is controlled by pneumatic valve PVl. The 
flow of steam into the heat exchanger is controlled by pneumatic valve PV2. 
The flow rate and pressure of the steam is measured by the differential pres- 
sure flow transducer (FT) and pressure sensor (PT). At the outlet flow of the 
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Fig. 6.14. A pilot scale shell-and-tube heat exchanger 

heat exchanger another platinum resistance thermometer (TT) measures the 
temperature of the water going into the hot water tank. 

For the test, the opening of cold water supply valve PVl was kept constant, 
while the opening of the steam supply valve PV2 was selected as the manipu- 
lated variable to regulate the temperature of the outlet water. The cold water 
supply valve was 40% open and the steam supply valve was 50% open with the 
system under open-loop control. At steady state, the temperature of the outlet 
water was 72^ C with a voltage value of 5.5V. The proposed auto-tuner was 
then applied to the heat exchanger. The sampling interval Tg was 0.5 second. 
The relay test was performed and the PID parameters obtained. A set-point 
change of 0.5V was then made to the closed-loop system. Figure 6.16 shows the 
control performances of the proposed tuning method and the standard relay 
tuning method. The proposed method works quite well. Because the capacity 
of the boiler is not sufficient, when cold water refills the boiler under relay con- 
trol, the steam pressure drops. This periodic drop acts as a disturbance which 
can be seen clearly in the plot. 
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Fig. 6.15. Schematic diagram of the heat exchange] 
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Fig. 6.16. Auto-tuner performance for a heat exchange application 



6.5 Extension to the MIMO case 



We have so far considered single- variable systems only. But the methods devel- 
oped are readily extendable to the multivariable case. An m x m multivariable 
process may be described in terms of its frequency response matrix as 
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(6.41) 



There are basically three different schemes for conducting multiple relay tests 
on a multivariable process. See a detailed discussion on this in Chapter 5. The 
sequential relay test scheme is addressed in Chapter 8. This scheme essentially 
leads to SIS 0-like problems, and the extension is easier, compared with the 
decentralized relay scheme. The sequential relay test is only a partial closed- 
loop method. A decentralized relay feedback test as shown in Figure 6.17 is 
a more desirable tuning test since it is a complete closed-loop method for a 
MIMO system. It causes less perturbation to the process, and tends to have the 
shorter test duration since all loops are closed simultaneously. The extension of 
the SISO methods to decentralized relay feedback is thus more challenging, 
and we shall concentrate on this for the rest of this section. 
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Fig. 6.17. Decentralized relay feedback 



For ease of presentation, we first consider a 2 by 2 process: 



5^1 (s)' 




9n{s) 9 i2{s) 


'Ui(s)' 


Y2(s) 




921 (s) 922{s) 


U 2 {s)_ 



(6.42) 



Assume that the system is at rest at ^ = 0. Decentralized relay feedback as 
shown in Figure 6.17 is then applied to the process. We wait for the system 
to reach a stationary oscillation at t = ti, then change the relay amplitude of 
one loop and continue the relay test until all process outputs reach stationary 
oscillation again, at t = ^ 2 - The process inputs Ui{t),i = 1,2 and outputs 
yi{t),i = 1, 2, from ^ = 0 to ^ = ^2 are recorded. The data after t > ^ 2 , can be 
duplicated due to the periodic nature of the signals if they are needed. 

The signals Ui{t) and yi{t) are multiplied by a decay exponential to 
form 



Ui{t) = Ui{t)e and yi{t) - yi{t)e a > 0. 



Applying the Fourier transform yields 




Ui{t)e 



I 



oo 



Ui{t)e = Ui{j(jj-\-a), z = l,2. 
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which satisfies 
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Mjuj) 



(6.43) 



Like the SISO case in Section 6.3, Yi(jcj) and Ui(juj) can be computed at 
discrete frequencies cj = cji, I = 1,2, • - , M using the standard FFT technique 
from i/i(t) and Ui(t), where M is the user-specified number of frequency response 
points. 

Since (6.43) is a vector equation, it is obvious that it is not sufficient to 
determine the process shifted frequency response G(jcj -h a). We now look into 
the signals Ui(t) and yi(t) again. If the relay amplitude were not changed at 
^ = ^ 1 , we can expect that the subsequent process inputs and outputs would 
continue the stationary oscillation with the previous period. We extract the 
process inputs and outputs data for t < ti from Ui(t) and pi(t) and duplicate 
inputs and outputs data for ^ to get a new series of process inputs 
and as if there were no change in the relay amplitude at t = ti. Applying 
the Fourier transform to them results in 



(6.44) 



In view of (6.43) and (6.44), the shifted frequency response matrix G(juj -f- a) 
of the multivariable process is obtained as 

n -1 
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(6.45) 

from which, the process frequency response G(jcj) may be recovered by using 
(6.32)-(6.34) elementwise. 

It should be noted that our method is not confined to the relay feedback 
case. It can also be applied to many other input excitative signals such as steps 
and ramps. In the proposed method, no iteration calculation is performed, no 
prior knowledge of the process is required, and as many points on the process 
frequency response as desired can be identified. 

The proposed identification method can be extended to a general m-input 
and m-output system with obvious modifications as follows. A decentralized 
relay test with m — 1 relay amplitude changes during the test is performed 
on the process, and the resultant process inputs and outputs which contain 
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m stationary oscillation limit cycles are recorded as u] (t) and (t) . From the 
and yl(t), m - 1 series data {uf(t),--- and (pfit),--- 

can be constructed as before, which contain 1, • • • ,m — 1 stationary limit cy- 
cles respectively. They are processed with the proposed transform to obtain 
{[/^(jcj), • ’ • and {V^(jcj), - • ,V^(jcj)}. The shifted frequency re- 

sponse matrix of the process is then given by 

G(Ju;+a) = [V^(juj) V'" (ju;) ••• (6.46) 

from which we then compute the frequency response G(ju) if necessary. 

Example 6.5.1. Consider the well-known Wood/Berry binary distillation col- 
umn plant (Wood and Berry, 1973): 



18.9e~^^ 
l+21s 

19.4e~^^ 

1+14. 4s 

For our method, a decentralized relay test with the same unit relay amplitudes 
in both loop 1 and loop 2 was performed first. The relay amplitude of loop 
2 was increased to 3.0 at t = 60 and the test continued. The resulting Ui{t) 
and yi{t) were recorded, and u[{t) and y'^{t) generated. The frequency response 
identified by the proposed method is shown in Figure 6.18. For this example, 
the ERR for elements ^ 11 ( 5 ), guis), g 2 i{s) and ^ 22 ( 5 ) are respectively 2.4%, 
0.59%, 0.62% and 0.58%. The accuracy of the proposed method is evident. 




The fitting method for SISO PID tuning in the preceding section can also 
be extended to the MIMO case. Consider a multivariable control system in a 
conventional feedback configuration with a multivariable process G{s) and a 
multivariable cross-coupled PID-type regulator K{s) given by 

K{s) = {kij}, kij = kpij + kiij^ + kDijS. (6-47) 

One can choose the objective closed-loop transfer function matrix as 

H{s) = diag{/ii} = diag{ (6.48) 

b L^^LUjiib - 1 " 

Then, the objective open-loop transfer function matrix is given by 

Q{s) = diag{gi} = diag{ ^ -— }. (6.49) 

With the process frequency response matrix G available and objective loop Q 
given in (6.49), the multivariable regulator K is designed such that GK is fitted 
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Fig. 6.18. Process frequency responses (+estimated; — actual) 



to Q as well as possible. A matrix version of the linear least squares frequency 
response fitting can be used to determine K. For multivariable processes with 
high dimensions, the matrix version of the linear least squares tends to be time 
consuming. To simplify this matrix fitting into a set of scalar fitting problems, 
the relationship between the diagonal and off-diagonal elements of a multivari- 
able controller which achieves complete decoupling is investigated. For ease of 
presentation, we partition an m by m system as 







Gil (5) ^12(5) 




Vi(s)' 






G2i{s) G 22 {s) 




U 2 {S)_ 



(6.50) 



where Y^is), C/ 2 ( 5 ), ^ 12 ( 5 ), G 2 i{s), G 22 {s) are matrices with dimensions (m - 
1) X 1, (m — 1) X 1, 1 X (m - 1), (m — 1) X 1, (m - 1) x (m — 1) respectively, 
and the multivariable controller matrix as 



Kn Ki2 
K21 K22 



K{s) = 



(6.51) 
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where K 12 , K 2 i^ K 22 are matrices with dimensions 1 x (m — 1), (m — 1) x 1, 
(m — 1) X (m — 1) respectively. For complete decoupling of GK, its off-diagonal 
elements at column 1 have to satisfy 

G 21 K 11 G 22 K 21 —0, (6.52) 

or 

K2i = -G^iG2iKn, (6.53) 

supposing non-singularity of G 22 - It follows that the diagonal element of GK 
at position (1,1) is 



GiiKii-{-Gi2K2i — {Gii—Gi2G22G2i)Kii — : GnKn. (6.54) 



We regard Gu as a generalized process. Matching GuKu to qi in the frequency 
domain yields 



Gn{jcJi)Kii{jLUi) = Gii{j(jJi) 






kpil 

kill 



kmi 



QiiM), 



(6.55) 



for Z = 1, 2, • • • , M. This is a SISO frequency response fitting problem as solved 
in Section 6.4, and the standard least squares method can be used to determine 
the controller parameters (fcpii, A^ni, fc/^n). 

With G 21 , G 22 and Kn available, the same frequency response fitting 
method is applied to (6.53) to obtain each element of K 21 , i.e. one needs to 
solve the following fitting problem: 



K2i{M) = -G22^(iw,)G2i(ju;;)^ii(jwj), ^ = 1, 2, • • • , M, (6.56) 



for each element of K 21 . Similarly, we determine other columns of K, 

Example 6.5.1 (cont’d). Based on the process frequency response matrix identi- 
fied earlier, the generalized process Gu is obtained from (6.54). The apparent 
dead time Li is 1.06. Choose gain margin and phase margin Ami = 5 and 
^mi = f 5 respectively, then we have = 0.61 and uJniLi = 0.33. Solving 
(6.55) yields 

fcii(s) = 0.0942 + 0 . 0483 I- 0.0237s. 

s 

The parameters of fei are then obtained by solving (6.56) using a least squares 
method to get 
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Fig. 6.19. Autotuning process ( — proposed method, BLT tuning method) 

A; 2 i(s) = -0.0463 + 0.022ll + 0.0347s. 

s 

Similarly, with ^2 = 0.707 and 0 On 2 L 2 = 2 for loop 2, we get 

k22is) = -0.0371- 0.0117^0.1135, 

s 

and 

ki 2 is) = 0.0855-0.01561 + 0.140s. 

s 

The whole tuning process and the resultant performance are shown in Figure 
6.19, where the set-point change of loop 1 and loop 2 occur at ^ = 141.5 and t = 
301.5 respectively. For comparison, the BLT tuning method of Luyben (1986) is 
also considered. For this multivariable process, the method gives the parameters 
of multiloop PI controllers as Kc = (0.375,-0.075) and Ti = (8.29,23.6). Its 
set-point change responses are also shown in Figure 6.19. One sees that the 
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proposed method gives significant improvement both in the system decoupling 
and the diagonal loop performances. 

Example 6.5.2. Consider the 3x3 plant in Loh and Vasnani (1994): 



G(.) 



119e~^^ 40e~^^ -2.1e~^^ 

21.7S+1 337S+1 lOs+1 

77e~^^ 76.7e~^^ -5e~^^ 

50S+1 28s+l lOs+1 

93e~^^ -36.7e~^^ -103. 3e~^^ 

. 50S+1 166S+1 23s+l 



With the default values Q = 0.707 and uJnLi = 2 for all three loops, the 
multivariable PID controller is obtained with our MIMO PID tuner as 



K{s)^ 



0.0218 + 0.000995! + 0.00967s -.0959 - 0.000131 ! - 0.000477s -0.00108 - 0.0000153! - 0.00113s 

-0.00841 - 0.000760 !+ 0.0126s 0.0720 + 0.00256 !+ 0.0254s -0.00462 - 0.0000397 !+ 0.00607s 

0.00776 + 0.000747! _ 0.00419s -0.00355 - 0.000330 ! + 0.00266s -0.0343 - 0.00142! - 0.0176s 

The responses for a set-point change in loop 1, 2 and 3 are shown in Figure 
6.20. The results show that our closed-loop is nearly decoupled and the diagonal 
loops have excellent performances. 




7. Transfer Function Modelling 



The preceding two chapters indicate that relay identification usually yields 
information on process frequency response. However, most modern control de- 
signs make use of parametric models. Transfer functions might be the most 
welcome parametric model. Fitting parametric models to frequency data is thus 
important (Ninness, 1996). Most existing methods for transfer function identi- 
fication are for delay-free processes (Ljung, 1985; Sagara and Zhao, 1990; Pin- 
telon et al, 1994; Tugnait and Tontiruttananon, 1998) or assume that the delay 
is known a priori. It has long been recognized that the inclusion of a time-delay 
term in a transfer function can drastically reduce the model order and facilitate 
cheap and more efficient implementation of both conventional and model-based 
controllers (Taiwo, 1999). A frequently used method for dealing with unknown 
delays has been to use a shift operator model with an expanded numerator 
polynomial (Kurz and Goedecke, 1981). Another popular approach is based on 
the approximation of the dead time by a rational transfer function such as the 
polynomial approximation (Gawthrop and Nihtila, 1985), Fade approximation 
(Souza et al., 1992) or Laguerre expansion (Malti et al, 1998). Such approaches 
require estimation of more parameters because of the increased model order, 
and could result in large unacceptable approximation errors, especially when 
the system has a large delay. These methods have been developed for discrete 
systems while continuous systems are more familiar to practising control engi- 
neers. Pintelon and Biesen (1990) present a Gaussian frequency domain max- 
imum likelihood estimator of the transfer function of linear continuous time 
systems with time delay based on a test using a multisine input signal. 

Model reduction is closely related to this transfer function modelling prob- 
lem as the frequency response of a given high-order model can be used as 
a nonparametric model for the latter problem. Reduced-order models are of- 
ten required to simplify the design and implementation of control systems. A 
reduced-order model is usually adequate, provided it has dynamic character- 
istics close to those of the original high-order system in the frequency range 
which is most relevant to control system design. For plants with rational trans- 
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fer functions, balanced truncation and the optimal Hankel norm approximation 
are popular model reduction methods. However, transfer functions encountered 
in the process industry usually contain time delay and may not fit into the form 
of a rational function plus time delay, due to multivariable interactions (see, 
for example. Chapter 9 of this book). 

In this chapter, we present two methods for transfer function modelling 
from the frequency response. One is to match the given frequency response to 
a transfer function response using recursive least squares fitting in the frequency 
domain. The other identifies a transfer function model from the time domain 
step response constructed from the given frequency response. The models under 
consideration are in the form of a rational function plus possible time delay. 
Great attention is paid to the preservation of stability for the resulting transfer 
function models. These two methods are applicable provided that the transfer 
function or frequency response is available. The design philosophy which Part 
III of this book takes is to first find an ideal controller which can achieve 
the best possible performance in some sense but could be too complicated or 
even not physically realizable, and then to exploit the methods in this chapter 
to get a much simpler yet good approximation to the ideal one for actual 
implementation. 



7.1 Prom Frequency Response 



Consider a single-variable system of possibly complicated dynamics with its 
transfer function G{s) (probably non-rational) or frequency response G{juj) 
available. The problem at hand is to find an nth-order rational function plus 
dead time model 



G{s)=go{s)e 



gn 



+ • • • -h + /?o 

g 

-f- an-is'^~^ H h ais + ao 



(7.1) 



such that the approximation error e defined by 



e = ^ \w{juJi){G{juji) - G{jui)) 

i=l 



(7.2) 



is minimized, where the interval [uji , ojm] defines the frequency range of interest 
and W (juJk) serves as the weighting. Note that (7.1) contains the unknown time 
delay L to be estimated and this makes the problem nonlinear. The solution to 
our model reduction is obtained by minimizing the approximation error over 
the possible range of L. This is a one-dimensional search problem and can be 
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easily solved if an estimation of the range of L is given. A reasonable search 
range for L is 0.5 ^ 2.0 times Lq which is the initial estimate of the time delay 
of G{s), and evaluate 15 ^ 20 points in that range to find the optimal estimate 
L. An alternative is to use a Newton-Raphson type of algorithm to search for 
the optimal L (Lilja, 1989), which requires no prior range for L. 

If the time delay L is known, then the problem becomes to approximate a 
modified plant go{s) = G{s)e^^ with a rational transfer function 



9o(s) = 



+ • • • + + ^0 

s" + -I 1- ais + ao ’ 



such that 



M 






(7.3) 



i=l 



is minimized. Equation (7.3) falls into the framework of transfer function iden- 
tification in the frequency domain. For this identification, a number of methods 
are available (Pintelon et al.^ 1994); the recursive least squares (RLS) algorithm 
is simple and effective and is briefly described as follows: 



M 



4^^ - \^i ^ H- ... + ap{jfo;i) + a, 



v(^)l 



i=l 






where 

A 






(joJi)"' + + OL^o 



(7.4) 



(7.5) 



acts as a weighting function in the standard least squares problem in braces. 
Equation (7.4) is re-arranged to yield 



M 






i=l 



where 



'nT' = -Po(M)(iwi)”M^^*\ 

= [po(M)(jwj)"“^ ••• ffo(jwi) -(M)" ... -(M) 



(k) 



(7.6) 

(7.7) 

(7.8) 
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Then, we have the recursive equation for as 




g{k,i) i = l,2,--. ,M, 


(7.9) 


where 






(7.10) 




(7.11) 


p{k,i) — _ J{{k,i)^ik)T^p(k,i-l) ^ 


(7.12) 



Once the above RLS in (7.9)-(7.12) has been completed, the resultant param- 
eter vector 6^^^ = is used to update to 



r r ^ 



1 

+ ... + a['°\ju}i) + ’ 



(7.13) 



and (7.9)-(7.12) are repeated to calculate On convergence, the resultant 

parameter vector will form one solution to (7.3). 

Different weighting functions are employed in the various methods (Pintelon 
et a/., 1994). For simplicity, it is recommended that is chosen as 

1 

(jwj)" + + ... + 

Simulation shows that the most important frequency range for model reduction 
is a decade above and below cjg , where Ug is the unity gain crossover frequency 
of the transfer function Go(5). Therefore, the frequency range [cji, ujm] in 
the optimal fitting problem (7.3) is chosen to span M logarithmically equally 
spaced points between O.lcj^ and lOa;^. 

Once a reduced-order model G{s) is found, the following frequency response 
maximum relative estimation error can be evaluated: 



ERR := max 

u ;€( 0 , ujm) 



G{ju)) - Gjjuj) 
G{jto) 



(7.14) 



The following criterion is used to validate the solution: 



ERR < e, (7.15) 

where e is the user-specified fitting error threshold, e is specified according to 
the desired accuracy of the RLR approximation to the original dynamics G{s). 
Usually e may be set between 1% and 10%. If (7.15) is met, the procedure 
stops. Otherwise, n is increased by 1 to the smallest integer n that satisfies 
ERR < e. 
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Algorithm 7.1 Seek a reduced-order model G{s) of order n in (7.1) given 
G{s) orG(juj), approximation threshold e, initial time delay Lq and parameter 
vector 6 ^ . 

Step 1. Choose N between 15 and 20, set AL = , and obtain Lk = 0.5Lq + 

kAL, ik = 0,l, - - ,AT. 

Step 2. Start with G{s) as in (7.1) with n = 1. 

Step 3. For each Lk, find the nth order rational approximation solution go{s) to 
the modified process go{s) = G{s)e^^^ with the RLS method in (7.9)- 
(7.12) and evaluate the corresponding approximation error ERR in 
(7.15) for G{s) = go{s)e~^^^. 

Step 4. Take as the solution G(s) that yields the minimum error ERR and 
ERR < e. Otherwise, n + 1 -> n and go to Step 3. 

The preservation of stability is a crucial issue in frequency domain based 
model reduction. Let G{s) = gQ{s)e~^^ be the value that yields the smallest 
approximation error e in (7.2). It should be pointed out that Algorithm 7.1 with 
zero initial parameter vector might result in unstable G{s), especially for high- 
order models, even though G{s) is stable. One can use stability tests and the 
projection algorithm (Ljung and Soderstrom, 1983) to constrain the poles of the 
model to be in the stable region. However, simulation shows that this method 
can slow down convergence of the recursive least squares considerably, and may 
result in large modelling error if the dynamics of the transfer function to be 
modelled is complicated. Here, we notice that since the problem of minimizing 
(7.2) is nonlinear. Algorithm 7.1 may give different local optimal solutions if it 
starts with different initial settings. Among those solutions, only stable G{s) 
models are required, given a stable G[s). If we initiate the algorithm with 
a stable model, the algorithm is likely to reach a stable approximate upon 
convergence. 

When n = 1, we set the initial model of G{s), 

Go = — (7.16) 

s H“ 0(0 

as follows. Matching Go{ju) to G{juj) at u — 0 and oo = ooc, where ooc is the 
phase crossover frequency of G(s), i.e., Z.G{juJc) — — tt, we obtain 

ao - G2(0)-|G(jw.)|2 ’ 

< /?o/ao = G(0), (7.17) 

M = ^^{-arg[G(ja;c)] - tan-i(^)}. 

When n — 2, one may adopt the following structure: 
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Go — 



^ e-^o* 

+ ais -h ao 



(7.18) 



Similarly, match Go{j^) to G{ju) at the two points u = uot and uj = cjc, where 
ZG{j(Ji)) = — f and /.G(jujc) = — tt. It then follows (Wang et a/., 1999d) that 
the parameters Po, ai, ao and Lq can be determined as 



’ sin(u)cLo) 
cos(a;f,Lo) 



U} c\G{juJc) 

b) ’ 



'\GUu)b) 



Oil/ 00 
OLo/Po = 



, COS ( uJcLo ) 

+ \G{ju;^)\ 



sin{ujcLo) 
Vc\G{juJc) \ ’ 






*\ \ sin(uJbLo) 

\G{ju;b)\ 



+ 



ujI cosjujcLo) 
\G{j^c)\ 



-1 



(7.19) 



For the cases n > 2, we can set the initial model Go(5) of the respective orders 
with Po, ao and Lq determined as in (7.19), while all the remaining high- 
degree coefficients are set to 0. Extensive simulations show that this technique 
works very well. 



Example 7.1.1. Consider a high-order plant (Maffezzoni and Rocco, 1997): 



G{s) = 2.15 



(-2.75 + l)(158.552-h6s-hl) 



14s 



(17.55 + 1)4(205 + 1) 

With zero initial parameter vector. Algorithm 7.1 gives a reduced-order model 
-0.02755^ - 0.00105 - 0.0001 



G{s) = 



-63.20s 



53 - 0.012952 - 0.00295 - 0.0001 



(7.20) 



which is unstable. When the parameters obtained from (7.19) are adopted for 
the initial model, we get 



G{s) 



0.4687s 2 + 0.0038s + 0.0024 
s3 + 1.2160s2 + 0.0665s + 0.0011* 



-41.90s 



(7.21) 



which is stable with ERR = 2.71%. The frequency responses of the actual and 
estimated models are shown in Figure 7.1. 



7.2 From Step Response 

In this section, we present a simple yet robust algorithm for the identification of 
linear continuous time-delay processes from step responses. New linear regres- 
sion equations are derived from the solution and its various-order integrals of 
the process differential equation. The regression parameters are then estimated 
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Fig. 7.1. Frequency domain model reduction 

( actual process; * * ♦ unstable model; — o — o — stable model) 



without iteration, and explicit relationships between the regression parameters 
and those in the process are given. Due to use of the process output integrals in 
the regression equations, the resulting parameter estimation is very robust in 
the face of large measurement noise in the output. The method is first detailed 
in Subsection 7.2.1 for a second-order plus dead time model (SOPDT) with 
one zero, which can approximate most practical industrial processes, covering 
monotonic or oscillatory dynamics of minimum-phase or non-minimum-phase 
processes. Such a model can be obtained without any iteration. A general model 
is addressed and theoretical supports are provided in Subsection 7.2.2. This is 
followed by implementation issues in Subsection 7.2.3 and simulation and real- 
time testing in Subsection 7.2.4. 

7.2.1 Second-order Modelling 

This subsection focuses on SOPDT modelling. It serves for motivation of the 
general method to be described in the next subsection and recommended for 
use in applications since such SOPDT models essentially cover most practical 
industrial processes (Luyben, 1990). 

Assume that a stable process is represented by 
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Y{s) - G{s)U{s) 



hs + h 

+ Ois + 02 



(7.22) 



Assume also that the process has distinct (possibly complex) poles and that 
the input is of step type, i.e., U{s) = h/s. Then the process output is 



Y{s) = KphXi \2 



0s + 1 

s{s + Ai)(s + A 2 ) 



,ao oi 
^ s s + Ai 



+ 



Ct2 



S + A; 



■)e 



-Ls 



Ai X2, 



(7.23) 



where oq = Kph, ui = -KphXiX 2 j^^:z^ and 02 = KphXiX 2 x^^Ai-A;) - 
Under zero initial conditions, the output time response is 



y{i) = 



0 , 

Kph + + a2e~^^^*~^\ 



if t < L; 
if t ^ L. 



(7.24) 



In real applications, such a step test is conducted on the process. The result- 
ing input and output responses, {u{t)^y{t),t = ^ 1 ,^ 2 , • * * }? ^re logged for the 
identification of model (7.22). The static gain, Kp, is easily found from the 
steady-state response as 



Kp = 



yjoo) 

h ■ 



The output transient response, Ay(t) = y(t) — 2 /( 00 ) = y{t) — Kph, can then 
be obtained from (7.24) as 



Ay{t) = 



Kph, 

Qlg-Ai(t-L) ^ 



\ft<L] 
if t ^ L. 



(7.25) 



For any time t ^ L, one integrates Ay{t) once and twice to give 

f‘ A,(n)dn = + fi. 

Jo ^1 ^2 A2 

(7.26) 

t r Ay{n)dTidT2 = ^KphL^ - KphLt + 

Jo Jo ^ \ ^2 

Equations (7.25) and (7.26) are combined into the matrix form: 



^y(t) 

fo ^y(n)dTi 



1 1 




aie 


+ 


0 


_ j L 

Ai A 2 _ 








-KphL + + ff _ 



Ax + B. (7.28) 
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One notes that the matrix A is nonsingular due to the assumed distinct Ai and 
A 2 , and thus (7.28) is solvable for x. Substituting the solution x of (7.28) into 
(7.27) yields 



Ay{Ti)dTid.T2 

= - + f ^y(.Ti)dn 

A1A2 Ai A 2 Jo 



- (tV - W + -i^ + ^ + L- l3)Kpht. 

Ai A2 ^ Ai A2 



Define 



n T2 

Ay{Ti)dTidT2, 

T 

(t>{t) = [Ay{t), f* Ay(n)dri, Kph, Kpht\ , 

^ [a^’ ^ ^ ^ • 

Then, (7.29) can be expressed as 



(7.29) 



(7.30) 



lit) = 



Invoke (7.29) ioi t = L, i = 1, 2, • • • , to form the regression; 



r = #(9, (7.31) 

where F = [ 7 (ti), 7 (t 2 ), • • • , 7(^iv)]^, and ^ = [<?i(ti), ^(* 2 ), • • • , (t>{tN)Y' ■ 
One can readily see that four columns in ^ are independent of each other 
and is nonsingular (the formal proof is given in the next subsection). Thus, 
the ordinary least squares (LS) can be applied to (7.31) to find its solution: 

e = (7.32) 

The first question which arises from (7.32) is whether or not the estimate 9 is 
consistent when there is measurement noise. To address this, suppose that the 
actual measurement of the process output y{t) is corrupted by measurement 
noise v{t)^ which is assumed to be a strictly stationary stochastic process with 
zero mean; then we have 



y{t) = y{t) + v{t), 



or 



Ay{t) = a\e ^^+a 2 C ^^-fu(t), fort^L. 
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Equation (7.31) will accordingly be changed to 

^0 = r + A, (7.33) 

where A = [<J(^i), <^(^ 2 ), • * * 5 and 

^(t) = f f v(Ti)dTidT2-{^ + ^) f v{Ti)dTi--^v{t). 

Jo Jo ^^2 Jo MM 

It follows from Soderstrom and Stoica (1989) that in such a case, the ordinary 
LS estimate in (7.32) is not consistent, because A{t) is now correlated with 
^{t). One solution is to use the instrumental variable (IV) method (Young, 
1970; Strejc, 1980). 

Proposition 7.2.1. For the system in (7.33), if the instrumental variable ma- 
trix Z is chosen to satisfy the following two limiting properties (Soderstrom and 
Stoica^ 1989): 

(i) the inverse o/limiv->oo exists; 

(ii) limjv_>oo = 0, 

then the estimate given by 

9 = (Z'^$)-^Z'^r (7.34) 



is consistent. 



There might be many choices for Z. The condition number. 



cond(Z^^^) 



a{Z'^^) 
QiZ^^) ’ 



may be used as a criterion for choosing a suitable Z, where g_{Z^^) and a{Z^^) 
are the smallest and largest singular values of the square matrix Z^$, respec- 
tively. With these requirements in mind, we choose Z as 






1 L ±2 J.6 

^ ^ H H 



1 1 ^2 ^3 

h h 



(7.35) 



1 1/2/3 

7T' 7T' I'M t'/V 
L^N ^ . 



The formal proof that it satisfies conditions (i) and (ii) is given in the next 
subsection. 




7.2 Prom Step Response 



179 



Once 6 is found from (7.34), one has to recover bi and L to obtain the 
process model (7.22). It follows from (7.30) and simple algebra that 

ai 

a2 _ 

^ ~ ± 

l\ 

A negative (3 corresponds to a non-minimum-phase process and causes an in- 
verse response, i.e., the output step response first moves in an opposite direction 
to its final value. A positive P corresponds to a minimum-phase process. Thus, 
by observing the output time response, one is able to determine ^ from 

if inverse response is detected; 
otherwise. 

This rule always works well if the underlying process is of second order or is 
second-order dominated. 

Remark 7.2.1. It is also noted that the number 2(03 — 0i) -h (04 —62)^ may 
sometimes be negative if the process behaves much differently from second- 
order dynamics. This gives rise to complex ^ and L, which is unacceptable. 
Usually, a higher-order model should be utilized in such cases and the problem 
is then overcome. If, on the other hand, a SOPDT model is still preferred 
for practical reasons (say, fixed hardware and software structure in the given 
controllers), the problem can formally be formulated as an LS estimation with 
the constraint 

mini ={r - §6) 

0 

s.t. 2{6s - 9i) + {6i - 62? 0, (7.37) 

or 

mm j^{r- ^df{r - $e) 
s.t. 6^ AO “I” BO ^ 0, 
where 

0 0 0 0 
0 10-1 
0 0 0 0 
0-101 



S = [ -2 0 2 0] ■ 





O2IO1 

l/Ox 

^2(03 - ) + (04 - O2Y 

04 — 02 + /? 
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The resulting solution guarantees real values for p and L, but requires more 
complicated calculations. A practical and natural choice for p is to simply 
take /? = 0, and this leads to L = 04 — + ^), or L = ^2(AiA2 — Os). 

A suitable choice for L could be one that minimizes the total squared error 

One can conclude from the development presented above that a SOPDT 
model can be identified from a process step response by applying a LS or IV 
algorithm only once without any iteration. The simulation and real-time im- 
plementation in Subsection 7.2.4 further show that the proposed identification 
is also very robust in noisy environments. It is thus appealing to extend this 
method to the general case of nth-order modelling. 



7.2.2 nth-order Modelling 



Suppose that a time-invariant stable process with distinct poles (possibly com- 
plex) is represented by a NOPDT model: 



y(s) = G{s)U{s) = 



^ ^ + • • • + &n-lS + X 

s”+ais”“iH ha„_is + a„ 



n 

= Kp^\i 
i=l 



nr=i(® + 






(7.38) 



where 



~ ^i 2 ’ ' ' ^ik 5 A: — 1, 2, • • • , n; 

bk = Kp rii=l Sl^ii<Z2< ' * ' ' An-fc5 

A; = 1,2, • • • ,n — 1; 
bn = Kp rii=i 



(7.38a) 



Assume that the input is of step type, i.e., U (s) = h/s, then the process output 
becomes 



yW = (2»+-2V-+-2V+-+- 



s 5 H“ Ai 5 4" A 2 5 + Ai 






(7.39) 



where 



aj = —Kph JJ A 



nr=7(i-AAj) 



*A,nr=M#,(Ai-A,)’ 



j = 1,2,- ■■ ,n. 



(7.40) 



Under zero initial conditions, the output time response is 
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y{t) = 



0 , 



lit < L\ 
iit^L. 



(7.41) 



Suppose that the static gain, Kp, is obtained first and separately from the 
output steady state as 

r. _ 2/(00) 

h ■ 

Otherwise, refer to Subsection 7.2.3 for our modification for simultaneous 
estimation of all the parameters. The output transient response, Ay{t) = 
y{t) — y{oo) — y[t) — Kph^ can be written as 



Ay{t) = 



-Kphy 



For an integer m ^ 1, define 

r*(m) pt2 

f[tu t2] 



a t < L; 
if t > L. 



(7.42) 



r(77l) pt2 pTn pT2 

/ Ay= / ■■■ Ay{Ti)dTidT2 ■ ■ ■ dr„_idr„. 

^ 2 ] J t\ J t\ J t\ 



Lemma 7.2.1. 




-^Kpht"^, ift<L-, 

- E™ o' .^KphL"^-^it - LY + Eti 






(7.43) 



Proof. The proof is by induction. For m = 1, the integration of Ay in (7.42) 
gives 



f 



Ay{Ti)dTi 



—Kpht, 

-KphL 



E"=i 



-Xi{t-L) 



I ^ 



if ^ < L, 
ii t ^ L, 



which coincides with (7.43) for m = 1. Suppose now that (7.43) holds for m. 
By definition, we have Ay = Aydr. For t < L, one sees that 

/ Ay^ { -KphT”^)dT = -j^—Kpht”^+\ (7.44) 

J[ 0 ,t] Jo ml (m + 1)! 



For t ^ L, it follows that 
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^(m+l) pm nt pm 

/ ^y- ^ydT + / ^ydr 

•/[O, t] Jo J[0, r] Jl J[0, r] 

pL -1 pt m—1 - 

= / ( -KphT^)dT+ -Vttt r^KphL"^-\T - lydr 

ft n 
i=l 



nL pm 



i=0 



‘ A!” 






^ (m - fe)! Af 



1 "" 1 

- g - L)‘ 



(m + 1)! 



+ y ~! o :»[ 

2=1 

(_l)m 



^m+1 



+ E 



(- 1 ) 



*-i 






Af +1 (m + 1 - fc)! XI 

2=0 ^ ^ 



2=1 



i) 



+ P-«) 

Formulas (7.44) and (7.45) verify (7.43) for m + 1. The proof is thus completed. 

For any time f ^ L, n -h 1 equations in (7.42) and (7.43) for m = 0, 1, • • • , n, 
are arranged into 



/ 1 




A 




9 


1 




h. 


X + 





where 

^=[^2/> /[S]^2/’ ••• ’ 



(7.46) 



A = 



1 1 



A. -A- 

Ai A2 



1 

1 

An — 1 



1 

1 

An 



(-Eh)""' 



(7.47) 



^=[(-xr)"’ (-h"> •••- 

x= ... Q ^_ je - An - i ( t - L ) , 
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(1 = 



i=l ‘ i=0 

n n-1 / -i\k-l 









-iT 






fi = 



n— 1 



-E 



1 

i!(n — i)! 



KphL’^-^{t-LY+J2ai[J2 

i=l fc=l 



(-1)*=-^ 1 
(n - fc)! Af 



(t-L)"-*]. 



Lemma 7.2.2. Tfte matrix A in (7.47) is nonsingular if Xi, i = 1,2, ••• ,n, 
are distinct. Its inverse is 



det{A) 

where 




to 


Anl 


A\2 A 22 * • 


• An2 


Ain A2n • * 


Ann^ 



(7.48) 



(7.48a) 

(7.48^>) 



Proof. Note that matrix A is a Vandermonda-like matrix and its determinant 
(Broyden, 1975) is thus given by (7.48a). It is non-zero in the case of distinct 
Ai, ^ = 1, 2, • • • , n. A~^ is given formally by (7.48), where Aij is the cofactor of 
the {ij)th element of A. 

Introduce an auxiliary matrix: 



1 




1 


1 


1 


1 


1_ 




1 




1 


1 






Aj_i 


p 


Aj + i 


An 


• 


.. _( 


1 \i-2 






••• 




•• -( 


1 \i — ^ 
Ai-J 






••• 


-(^y ■ 


. . — 


Y 


P' 




••• 




-( 


1 \n-l 




1 


••• 



M(p) = 
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One immediately sees 



Mij — Aij, 



(7.49) 



where Mij is the cofactor of the (ij)th. element of M{p). Since M{p) is again a 
Vandermonda-like matrix, its determinant is given by 



det[M(p)] = { n (- 



l^k<l^n 

k,l^j 




i)>{ n 



l^k^n 




(7.50) 



For this polynomial in p, the coefficient of p^ 






l^k<l^n 

k,l^j 



- —) 

A; ^ A* 



V — 

A^i 

jl,-" 



1 



(7.51) 



On the other hand, one may also apply the Laplace expansion theorem to the 
jth column of M(p) to find its determinant: 



det[M{p)] — Mij-\-M 2 jp-\-' ' '-\-Mijp^ ^ - '-\-MnjP^ (7.52) 



Collecting (7.49) - (7.52) yields (7.486). 

Since A is invertible, x is solved from the first n rows in (7.46) as 
X = A~^{f-q), 



and is substituted into the last row in (7.46) to give 



/ Ay =p^A~^f+{n-p^A~^q). 

J[o,t] 



After lengthy but straightforward algebra, one reaches 
(fF{t)9 = j{t), t ^ L, 



(7.53) 



where 7 (t) = - Ay, 9{t) = [ 61 , 62 , ■ • • ,^ 2 n]^, 

< - ^*1 ^'k-l 

TTCT ’ 

_A + y-”-! L^-i . 

n?=i Ai ^ ^i=0 (n-j)! ^ 



6 k 



for A; = 1, 2, • • • ,n; 



• • • - fti. for fc = n + 1; 

n?=i Ai 

' 2^j=0 (2n+l — A;— j)! ■' 



^2n+l-A; (_i)2n fe j ^2n4-l-fc-? 



’ -<^ ^ 71-1 l^hPi 2 " ' for fc — n + 2, • • • , 2n, 

(7.54) 
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are dependent of the parameters of the NOPDT model in (7.38), and 

4>{tf 

^ fl;-^^Ay,Kph, Kpht, 

can be obtained from the output response. Equation (7.53) for t = ti ^ L, i = 
1, 2, • • • ,N,ti < ^2 < • • • < ^AT, is arranged into the matrix form: 

= r, (7.55) 



where 

T T 

Lemma 7.2.3. is nonsingular if the process is of nth or higher order with 
distinct poles and the sampling number satisfies N 2n, 

Proof. For simplicity, we consider only the uniform sampling case, i.e., — 

ti = Ts, i = 1,2, • ' ,N — 1, where is the sampling period. The proof can be 
extended to the case of different sampling intervals. 

Suppose that there are real Cj G E, z = 1, 2, • • • , 2n, such that 

^[ci , C2 , • * • , C2n] — Oj 
or 



Ayi 

Ay2 




■f(n-l) ^ 1 
Av 

j[o,t2] y 




~Kph 

Kph 




1 Pf 


+ • • • + Cn 


+ Cn+1 


+ • • • + C2n 


1 ly U-i.n—1 

{n-iy.P'^^2 


1 




LJ(0,tjv] 




Kph 




1 ry u^n — 1 

l(n-iy.P'^^N J 



= 0, (7.56) 



where Ayi = Ay{ti), i — 1,2, - - ,N . li not all ci, i — 1,2,- - ,n, are zero, 
subtracting the (fc — l)th row in (7.56) from the fcth row, k = N,N -I, - • • , 3, 2, 
yields 
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Ayi 




1 

;3i 




'Kph 


Cl 


Ays - Ayi 


+ • • • + Cn 


l[kt2] ^y -/ikti] ' ^y 


+ Cn-\-l 


0 




.^Vn — ^Vn-1. 




J[o,tM] ^y ~ /[o,tjv-\] ^y~ 




0 



+ Cn+2 


phti 

KphTs 


+ • 


• + C2n 


1 iy u-i-n—1 

(n-iy.P'^^1 

^Kph{tr^-tr^) 




_KphTs_ 






1 

1 1- 
1 

<?i» 

1 



Extract the last N — 1 rows in (7.57) and subtract the {k — l)th row from the 
A:th row, A: = A^, — 1, • • • , 4, 3, to give 



Cl 



Ay2 - Ayi 
Ays - 2Ays + Ayi 



+ ••■ + 



AVn ~ + ^Vn- 2. 



~^Cn 



r(n-l) 

J[0,t3] 



f[0,t2] ^ l[Wl] ^ 

^2/ - 2 /[o ' Ay + * 



Ay 



r(n-l) 

Lj[0,iiv] 



Ay 



9 r(n-l) 






Ay 



+Cn+2 


KphTs 

0 


+ • 


* + C2n 


T^Kph{tr^-tr^) 

j^Kph{tr^-2tr^+tr^) 




0 






\_(n-l)\^P^(^N + ^Ar-2)J 



Repeat this operation n — 2 more times to produce 



Ayn^, - {X)^Vn + {l)Ayn-i + • • • + {-lT{l)Ay, 
Ayn+2 - i^)Ayn-\-i + {^)^yn H 1 - {-lYi^Ay2 



+ ••• + 



.^2/ TV ~ (i)^2/tV-1 + (^^yN-2 + * • • + ( — 1)^(^)^2/TV- 
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-hCn 



/[o;„V.] - (i) ^2/ + ( 2 ) hz! 



^,Au+... + (~irc)f;Zi^y 

Ay + ... + (-l)n(2)jn-^^Ap 



L/[0,tiv] (1) '^[0,tAT-l] (2) /[0,tjv-2] ^ ^ ^)""(n) f[ 



J[0,tN- 



= 0 , 



J^2/J 

(7.58) 



which has (N — n) rows left, where (^) = TTf^Ti)! • 

Suppose that the order of the true process is n and note from (7.41) that 

h 

Ay{t) = y-Kph = ^ for L. 

i=\ 

With a tedious but straightforward calculation, one can express (7.58) as 





E”=iC 






{-ir-^Ef=i#r 


Cl 


E”=i 


+ • 


' ' Cfi 






Xf=i 









L. ^ 

= 0 , (7.59) 



where 






(1-e 



-\iTs 



)"^0, 



i = 1,2, • • • ,n. 



Under the assumed h ^ n and N ^ 2n, the first n rows in (7.59), after Guassian 
elimination, become 



_ j_ 
Ai 

I ^ 



I ^ L 











Cl 




C2 




_Cfi_ 



= 0 , 



and thus c^, i = 1, 2, • • • , n, are zero since Aj, i 
to be distinct. Therefore, (7.56) reduces to 



(7.60) 



1, 2, • • • , n, have been assumed 



^n+1 


Kph 


+ Cn+2 


p hti 

Kpht2 


\-C2n 


1 U4^n—\ 

{n-iy.P'^^2 




_Kph_ 




Kphtjsi 




1 

1 

<^4- 

1 
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or 





'1 h 


1 4.n—l 

(n-l)!*’! 




^n+1 


Kph 


■■ 


1 4 .n—l 

{n-l)r2 




t^n+2 




_1 fjv • • 


1 4-n—l 

■ (n-l)!^A^ J 




^2n 



The n columns of the coefficient matrix are linearly independent, which leads 
to a = 0, i = n-f- 1, n + 2, • • • , 2n. Thus, all Ci, z = 1, 2, • • • , 2n, are zero and the 
columns of ^ are linearly independent. Since the matrix ^ has 2n independent 
columns, is nonsingular (Broyden, 1975). 



The least squares solution of (7.55) for 6 which minimizes the following 
equation error: 

is given by 

e = (7.61) 



In practice, the true process output y is corrupted by measurement noise 
v{t) as 

y-y-\-V. (7.62) 



Here v is assumed to be a strictly stationary stochastic process with zero mean. 
In this case, (7.55) is modified to 



^(9 = r + zi, 

where A = [Si, S 2 , • • • , and 



(7.63) 



= 



/ ^ iT^ \ \ I ^ \ I 

^l^ii<i2<--<in-i^n ’ Kn-i 



AiAo 



p(n-l) 

/ "" 



rii=i Ai j[o 

For our case, the instrumental variable matrix Z is chosen as 






X 1 

tn •• 

X 1 



Ti ti • • • r 



n+l 

1 



1 J.3 ... y.' 

.2n-l ^2 ^2 ^2 



n+l 



(7.64) 



11 1 . 1.2 +3 ./^ n +1 
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Lemma 7.2.4. For the system (7.63), the matrix Z in (7.64) is an instrumen- 
tal variable matrix which satisfies the conditions in Proposition 7.2.1. 



Proof. Partition Z and # as 

z = [zi,Z 2 ,--- ,Zn]^ , ^ = [01,<A2,--- ,4>Nf' ■ 

Denote 

where i = 1, 2, • • • , AT and fc = 1, 2, • • • , 2n, we have 
N N j, 

= 'Z ^ [V’l,*. ^2,t, ■ • • , V’2n,i] 

Z=1 Z=1 

T 

= [E^I V’l.i, E!Ii V’2,i, • • • , Eill V’2n,i] • 

Suppose that there are q G E, z = 1, 2, • • • , 2n, such that 

N N N N 

Cl \-Cn ^2 '0n,2 + Cn+l ^2 \~C2n ^2 '^2n,i = Oj 

i=l i=l i—1 i=l 

(7.65) 

or 

N 

^ + C2t- 4- Cn+ltl 4- • • • H- ~ 0- 

i=l 

Since Ay is corrupted by measurement noise u, (f)J ,i = 1,2,--* ,A^, are linearly 
independent with probability one, (7.65) leads to 

Ci^r"'! • H hC2„i"+^ =0, i = 1, 2 • ■ • , 

or in matrix form: 





1 


1 




. 


J.n+1 

' h 




r -) 


xn 




.2n-l 




Cl 


X 


1 


1 






^n+l 
* ^2 




C2 


xn 


y^n + l • 


.2n-l 

^2 




1 


1 


1 




.. 

fcjV 


j.n+1 

^AT 




C2n_ 


l^N 


j.n + 1 


.2n-l 





It is clear that the columns of the coefficient matrix are linearly independent. 
This implies c* = 0, i = 1, 2, • • • ,2n, and therefore all columns of Z^^ are 
linearly independent. 




190 7. Transfer Function Modelling 



Let g(N) be a function of N. Denote 0{g(N)) {k is an integer) if 

liniiv->oo c, a nonzero constant. Noting that Ay{t) meets (7.43) and is 

corrupted by zero-mean stochastic process v{t), it follows that 



lim —Z^ # 
N-i-ooN 



: lim — 

N-*-ooN 



^i = l 


■ 

t 


• sill 


r(n-l) 

tv- 

t 


^Vi 


2f=i 


^ •• 


Kph 

■ 


^iV 1 

^*=1 u 








f(n-l) 


Avi 




Kph 




-X- 


^i = l 


^2n — 1 


^1=1 


tv 

t 








■ 

(n-l)\ 


2^i=i tT 

t 


i:f=t 




• • Eili * 


2 r(ri-l 

i J[0,tjv 


] ^Vi 


Eili 


Kpht^ •• 


Kph L^n + l 

^5r)r ^i=i 


*? 


.. 




ho,iN] 


Fill * 


:pht^+^.- 


Kph 


fLi Kpht‘f^ 



••• O(j^) 0( ) ••• 

N'nTT ) ••• ‘^^773’^ ivn + r > ••• O(^) 







■■ 




0 

to 

3 M 
' 1 
to 


0(N) 


O(N^) 


O(N^) 


0(At2) 


O(N^) 


O(N^) 


O(N^) 


•• 0(iV” + l) 


O(N^) 


O(iV^) 


O(N^) 


Q(^n + 1) . 




Q(^n + 1) 


0(N^+^) 



Q(jVn + l) 
0(7V”+2) 



0{N^^) 



For the above matrix, it can be seen that the product of any n elements, 
one from each row (or column), is of the same order as iV®, i.e., 0(1). The 
determinant of this n x n matrix involves the sum of all such nl products. 
Therefore, 

det( lim ^Z(Nf^(N)) = 0(1), 

N-^OO iV 



and the inverse of limiv^oo exists. 

By the assumption, u is a strictly stationary random process, and its statis- 
tics are unchanged by a time shift in the time origin. Equivalently, its distri- 
bution of all orders are independent of the time origin (Barkat, 1991). This 
indicates that 8{t) and the elements in Z are independent. Therefore, the in- 
strumental variables are uncorrelated with Z, or 



lim — Z^zl = 0. 
AT->oo N 



In view of the above development, we can establish the following theorem. 



Theorem 7.2.1. For a linear time-invariant process of nth or higher order 
with distinct poles, if the noise in the output measurement is a zero-mean 
strictly stationary stochastic process and the number of output samples N meets 
N ^ 2n, then the estimate given by 
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§ = {z'^^y^z'^r (7.66) 

is consistent, where Z is given in (7.64). Under noise-free circumstances, Z 
may be replaced by 

Once 0 is estimated from (7.66), one has to recover the process model (7.38). 
It follows from (7.38a) and (7.39) that 



O'k — 0^ -) /u — 1, 2, • • • , n 1; 



and 

ey 

en+i = 



0n+ft — 0fc 4" 



n! {n-i)\ 

(_l)n-fc 



(7.67) 



(n — fc + 1) 



1 / -wn—k—i 



6n “ (n - 1)! 

A: = 2,3, • • • ,n. 



(7.68) 



For k = n, (7.68) gives 

^2n — H" Tv — 1 ? 

I\p 

from which bn-i can be expressed as a linear function of L as 

bn-l — ~^(^n~^ L — 62 n)- 
ai 



Substituting this expression into (7.68) for /c = n — 1, bn -2 can be expressed as 
a linear function of L and L^. Repeat this operation for all other k in (7.68); 
each bi can then be expressed as a linear function ofL,-- - ,L\i==l,-* - ,n — 1. 
Further substituting all these expressions into (7.67), an nth degree polynomial 
equation in L is derived, from which n roots of L can be easily found. In 
determining a suitable solution, a rule of thumb is to choose the one that leads 
to the following minimal estimation error standard deviation between the actual 
step response recorded from the actual process, y(kTs)^ and the step response 
of the estimated model, y(kTs), where the estimation error standard deviation 
is defined by 



err = ^ ^[y{kTs)-y(kTs)]^. 
^ k=l 



(7.69) 
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Remark 7.2.2. In the proposed algorithm, instead of using noise-accentuating 
derivative operations on noisy signals, numerical integration is used to make 
this method robust to noise. Using the IV method, the proposed method also 
gives consistent estimates when the output is corrupted by measurement noise. 

Remark 7.2.3. The efficiency of an estimator can be evaluated by its closeness 
to the Cramer-Rao Lower Bound (CRLB). However, for our algorithm, we are 
unable to do so. To our best knowledge, the methods available for calculating 
CRLB assume additive noise, where the noise is supposed to be white Gaussian 
noise or colored noise (Kerr, 1989; Kay, 1993; Ghogho and Swami, 1999). The 
noise part A in our case is, however, a nonlinear transformation of where v is 
assumed to be a strictly stationary stochastic process with zero mean. There- 
fore, the existing methods cannot be applied directly to calculate CRLB. Fur- 
ther, the statistical properties hold for the parameter 0, but not for the original 
transfer function parameters, since the transformation from 6 to model param- 
eters is nonlinear. The efficiency of the estimator for 6 does not necessarily 
imply efficiency for the transfer function parameters and it is hard to address 
statistical properties for the latter. In view of these difficulties, CRLB is not 
calculated or checked here. Instead, the effectiveness of the proposed method 
is demonstrated by simulation examples as well as implementation tests. 

Remark 7. 2. 4- It should be pointed out that numerical integration techniques 
introduce errors, especially close to the Nyquist frequency. Numerical integra- 
tion has been extensively studied in the literature. In general, there is no fixed 
rule for deciding which numerical integration method is the best, and it de- 
pends mainly on the integrands and the individual problem itself (Dai and 
Sinha, 1991). To match the ideal integrator characteristics as closely as possi- 
ble within the frequency band of interest, digital filter design methods (Pintelon 
and Schoukens, 1990) can be applied. 

Remark 7.2.5. In practice, most processes are inevitable of high order with 
inherent nonlinearity, and it is rare to have duplicated or even close poles in 
the reduced-order model. However, complex symmetric mechanical structures 
may have multiple complex poles (multiple resonance frequencies), which are 
very close to each other. This will cause bad numerical conditioning and is a 
topic for future work. 

7.2.3 Implementation Issues 

In this subsection, several practical issues concerning implementation of the 
proposed algorithm are discussed. 
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Choice of ti It is noted from the above development that the first sample 
y{ti) should not be taken into the algorithm until ti ^ L, when the output 
deviates from the previous steady state. In practice, the selection of the lagged 
y{t) after U ^ L can be made as follows. Before the step test starts, the process 
output is monitored for a period called the ‘listening period’, during which time 
the noise band Bn can be found. After a step change in the process input is 
applied, the time t at which y{t) satisfies 

abs{mean{y{t — T to t))) > 2Bn 

is considered to meet t > L, where r is a user-specified time interval and is 
used for averaging. 

Choice of tN The initial part of the step response contains more exten- 
sive frequency information than the later part. In fact, the part of the response 
after steady state contains only zero frequency information, i.e., at a; = 0. 
Therefore, it is meaningless to use more data in the algorithm after the steady 
state, and tjsf should satisfy 

L <C tjv 

where Tget is the settling time, defined as the time required for the process to 
settle within dz2% of its steady state. 

For most processes, the frequency response usually shows higher gain at 
the low frequencies than at the high frequencies. Also, a step test excites slow 
dynamics more effectively. Thus, the relative error of frequency response iden- 
tification is likely to be dominated by high frequency errors. It can be seen 
that the transient part of the time response truncated at smaller In contains 
more information at high frequencies, and identification based on best fitting 
will naturally lead to smaller error in frequency response estimation at high 
frequencies and thus over the whole frequency range. In such a case, however, 
time response beyond this time is not taken into account and thus the time 
domain error in identification measured over the whole time response period 
will become larger due to possibly poor matching of data outside the span. In 
view of this analysis, there exists a trade-off between the estimation accuracy 
in frequency and time domains. After extensive simulations, it is recommended 
that be set at O.ST^et- 

Choice of N The computational effort becomes heavy if too many sam- 
ples are taken into consideration, leading to large Moreover, or 
may tend to become ill-conditioned for very large N and this may cause com- 
putational difficulty in estimating 6. Therefore, N has to be limited. For the 
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case with a large number of recorded data points, the default value of N is 
recommended to be 200, and ti may be set as 

i — 1 

ti — ^1 H {tN ^l)? N. 

Computation of Solution The solution formulas (7.32), (7.34), (7.61) 
and (7.66) are used for theoretical purposes only. In real applications, to com- 
pute the solution in a numerically stable way, QR decomposition or single- value 
decomposition methods are applied to get the solution of the linear equation 
system: 



m = r 



for the LS problem, or 

z'^00 = z’^r 

for the IV problem. 

Recursive Solution The LS solution in (7.61) and IV solution in (7.66) 
are non-recursive and require matrix inversion. Alternatively, one can easily 
cast them into a recursive version that requires no matrix inversion (Young, 
1970; Strejc, 1980; Soderstrbm and Stoica, 1983). This is a standard practice 
and thus requires no further discussion. 

Model Order In general, the order of the process is unknown. For most 
identification schemes, a model of known order is assumed (Strejc, 1981). Our 
method may also follow such a strategy. Alternatively, the model order may be 
pre-set to two since a SODPT model with a zero introduced, as discussed in 
Subsection 7.2.1, can describe most dynamics well. If the mean square error in 
(7.69) is too large, the model order is increased by one and a higher-order model 
is estimated following the general identification method in Subsection 7.2.2. 

Estimation of Kp It is common practice in process control to read oflF 
Kp directly using the steady-state output as Kp = y{oo)/h. However, there do 
exist cases in which the step test stops before the steady state is reached, or 
the user wishes to estimate all parameters together in a consistent way. Then, 
with obvious modifications to the derivation in Subsection 7.2.2, the following 
regression equation can be derived: 

where 6{t) = [6i 62 • • • ^ 2 n+i]^ and 
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6k = { 



TTCT 



for A; = 1, 2, • 



^pZ)j =0 ^ (n-j)l ^ Sl^ii<22<- •<ij^n-l ‘ " Aj ? 

for k = n -h 1, 

K y^2n+l-fc (-1)^^-*^-^ J^2n+l-k-j o. . . . 

for A: = n + 2, • • • ,2n, 



for A; = 2n + 1, 



^=[- 


/[o,n] 2/’ 






and 


2/(^1 ) 


2/ ^*1 • • 


1 U4.n-i 




y(* 2 ) y- 


/[S’ yh hh • • 


1 

(n-iy.^2 




.y(tN) /[S,”;? y- 


/[S^ y^^tN-- 


1 



Thus, a LS-like algorithm can be applied and Kp can be estimated simultane- 
ously with other parameters. 

Data Screening In the course of a step test, it is possible that the 
process is perturbed by a sudden rapid disturbance. This corrupts the process 
response and the corresponding samples are obviously unreliable and should 
not be used for identification. For the proposed identification method, a data 
screening technique, i.e., discarding those bad samples and retaining only the 
reliable ones, is applicable since essentially ti and can be any time between 
L and Tset> To see this, the proposed algorithm before calculating 6 is applied to 
each batch of good data to form respective Tj, i = 1,2. They are combined 
to form 



1 

1 




1 


1 

1 




1 

to 

1 



which is already in the normal regression form and used to find 6. This feature of 
data screening is quite attractive and time saving, especially for slow processes 
frequently encountered in process control. 

Impact of Offset Errors Low frequency noise and offset errors could 
cause estimation errors to the proposed method. This is a common problem to 
any identification method using step tests. As stated in Schoukens and Pintelon 
(1991), the test signal should enable us to inject as much energy as possible, 
or a high signal-to-noise ratio is required. This implies that offsets should be 
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small. The current control engineering practice is that any control test has to be 
carefully planned and prepared to ensure that the process is in a good steady- 
state condition with all major inputs well controlled or monitored before a test 
is actually applied. In other words, practising engineers try to avoid any signif- 
icant disturbances coming into the process during the test, and will be alerted 
when a significant disturbance is detected (this usually requires the test to be 
redone). If there exist inherent offsets, they may cause significant estimation 
error in Kp^ which further leads to estimation errors in other parameters. In 
such a case, the problem can be solved if Kp is known or obtained a priori. 
Sometimes, the steady-state gain may be found from physical/chemical princi- 
ples. If Kp is not available, techniques such as the relay test (Hang et a/., 1993a) 
may be employed to get an accurate Kp. With a known Kp^ the effect of the 
offset on the step response can be eliminated from the recorded data, and the 
proposed method is then applied to the modified step response. 

7.2.4 Simulation and Real-time Test 

The proposed step identification method is now applied to several typical pro- 
cesses. Without loss of generality, a unit step is employed in all the simulations 
below. For a better assessment of its accuracy, identification errors in both the 
time domain and the frequency domain are considered. This is because some 
step identification methods are found to be able to fit the process response well 
in the time domain, but the frequency response of the model sometimes devi- 
ates too far from the real process frequency response. To achieve better control 
performance, the estimation error should be small in both time and frequency 
domains. Comparison is made with the area method and graphical methods, 
to show the performance enhancement. 

The time domain identification error is measured over the transient period 
by the standard deviation, err as defined in (7.69). Once the identification is 
carried out, the model G{s) is available and the frequency domain identification 
error is measured by the worst-case error, ERR as defined in (7.14), where, the 
frequency range [0, Uc] is considered with ZG(jcUc) = since this range is the 
most significant for controller design. To test the robustness of the proposed 
method, noise is introduced into the process output. In the context of system 
identification, noise-to-signal ratio defined (Hay kin, 1989) by 

mean(abs(noise)) 

mean(abs(signal))’ ^ ’ 

is used to represent noise level. 
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Example 7.2.1. Consider a high-order monotonic process: 



G{s) 



1 

(S + 1)5 • 



A unit step test is performed, and the process input and output step response 
are recorded. In the noise-free case, the model estimated with the proposed 
method is 

g-1.4491s 

^ 4.3988s2 + 3.4499s + 1 



for the default tjsi — O.STset ^ 8.47s, where the errors are err = 1.1034 x 10”^ 
and ERR = 4.5728%. To see the effect of tN on identification, smaller and 
larger values of are tested as follows. If tjv is set to 0.7Tset 7.41s, the 
errors become err = 1.8294 x 10“^ and ERR = 4.5063%. If tN is set to 
be Tset ^ 10.59s, the identification errors become err = 7.1736 x 10“^ and 
ERR = 9.5715%. As stated in the previous subsection, a smaller tN leads to 
a larger err and a smaller ERR, while a larger tN gives a smaller err and a 
larger ERR. The recommended tN here is a good trade-off. 

For comparison, the area identification method and the graphical methods 
are also applied. The area method gives 

g-2. 6400s 

^ 2.3772s + 1 ’ 



with err = 1.9276 x 10 ^ and ERR = 50.1586%, and the graphical method 
gives 



G(.)- 



g-l. 3526s 

4.714352 -f 3.5774s -hi’ 



with err = 1.1215 x 10“^ and ERR = 7.6723%. 

To improve the accuracy, the proposed method yields a third-order model: 

0.2711s2-h 0.1953s -hi 



G(s) = 



„-l. 3264s 



2.6222s3 -h 5.2668s2 -h 3.8870s + 1 
with err = 1.0858 x 10“^ and ERR = 1.5359%, and a fourth-order model: 
0.0076s^ -h 0.1722 s 2 -h 0.2948s -h 1 



G(s) = - 



-0.8365s 



7732s4 -h 5.9048s3 -h 7.6344s2 -h 4.4782s + 1 



with err = 6.0577 x 10 ^ and ERR = 1.3001%. The results are quite accurate 
and the effectiveness of the proposed method is obvious. 



The identification results for a variety of different dynamics are listed in 
Table 7.1, and the effectiveness of the proposed method is evident. 




Table 7.1. Identification results 
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Example 7.2.2. To demonstrate the robustness of the proposed method, step 
tests with measurement noise NSR = 3%, 5%, 10%, 15%, 20%, 30%, 40% or 
50%, were performed for the process: 



G(s) 



-4s + 1 
9s2 + 2.4s + l® 



The results are listed in Table 7.2. The robustness of the proposed method 
with the IV solution is obvious. To compare the LS and IV methods, consider 
NSR — 10% for instance; the LS solution is 



Q(g\ — 3.81198 + 1.0248 1.3252s 

^ ^ 7.4998s2 + 2.2273s -f 1 



with err — 5.47 x 10 ^ and ERR — 16.63%, while the IV method produces a 
better solution: 



Qr \ _ 3.8610s + 1.0248 i.p 457 g 

^ ^ 9.0035s2 + 2.4207s + 1 



with err = 3.11 x 10 ^ and ERR = 4.04%. 



Example 7.2.3. To see the applicability of the proposed method to nonlinear 
systems, consider the system (Slotine and Li, 1991): 

f 

xi — sina:2, 

< X2 — x\ COSX2 -f u, 

^y{t) =xi{t-2). 

With NSR = 10%, the SOPDT model is estimated as 

\ _ -2.0784s 

4.7184s2 + 3.1780s + 1 

The step responses of the process and estimated model are shown in Figure 
7.2. The effectiveness of the proposed method can be observed. 

Example 7.2.4- The proposed identification method for the SOPDT model 
was applied to a pilot plant, a coupled-tank control apparatus, made by Ken- 
tRidge Instrument Ptd. Ltd, Singapore. The equipment consists of two small 
tower-type tanks mounted above a reservoir which functions as storage for the 
water (Figure 7.3). In this implementation, the baffle between the two tanks is 
raised to allow water to flow between the tanks. The objective is to control the 
water level in the second tank by manipulating the voltage to the pump in the 




200 7. Transfer Function Modelling 





7.2 Prom Step Response 



201 




Fig. 7.2. Step responses for Example 7.2.3 

( : actual process; : estimated model from the proposed method) 




Fig. 7.3. Coupled-tank level control system 



first tank. Using the proposed identification method, the process was modelled 
as 

^ , 1068.5638s + 62.2012 4092 ^ 

°W = 626 W + 66 . 8088 »+l '= ' ' 

and the response for this G{s) under the same step input is shown with the 
solid line in Figure 7.4, where the dashed line is from the actual process. The 
effectiveness of the proposed method is clear. 
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Fig. 7.4. Step response of coupled-tank 

( : from process; : from model) 



7.3 A Hybrid Approach 

The method described in Section 7.1 cannot guarantee the preservation of sta- 
bility of transfer function models. This is a typical problem associated with 
frequency domain methods. On the other hand, with the time domain ap- 
proach it is easier to deal with stability preservation. One sees that the step 
response of a stable G{s) will remain finite while that of an unstable G{s) will 
tend to infinity. The squared error between them will diverge, and an unstable 
G{s) must be excluded from the solutions to the problem of minimizing such 
an error, in other words, the solution must be stable. Based on this idea, we 
present a time domain transfer function modelling algorithm in this section. 
This algorithm not only preserves stability but also enables non-iterative esti- 
mation of all model parameters including the time delay. It constructs the step 
response from the frequency response and then uses the identification algorithm 
described in the preceding section to obtain the transfer function model. 

Construction of Step Response from G{s) or G{juj) Suppose that 
the plant is stable with G{s) or G{ju) given. Let the plant input u{t) be of step 
type with size h. Then the plant output step response in the Laplace domain 
is 

r(s) = G(.)J. 



(7.71) 
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It seems very easy to obtain the corresponding time response y{t) by simply 
applying the inverse Fourier transform However, since the steady-state 

part of y{t) is not absolutely integrable, such a calculation is inapplicable and 
meaningless (Wang et al., 1997c). To solve this problem, y{t) is decomposed 
into 



y{t) - y{oo) + Ay{t) = G{Qi)h + Ay{t). 



Applying the Laplace transform to both sides gives 

F(s) = ffl + £{42/(i)}. (7.72) 

Bringing (7.71) in, we have 



C{Ay(t)} = h 



g(^)-g(o) 

s 



Applying the inverse Laplace transform yields 



Ay{t) = hC 



G{s) - G(0) 
s 



}• 



Thus, the plant step response is constructed as 



= (7.73) 

J(jJ 

where may easily be implemented by the inverse fast Fourier transform 
(IFFT). 

Identification from Step Response Apply the algorithm in Section 
7.2 to the step response y{t) in (7.73) to get 



G(.)- 



biS^ ^ -f ^ + • • • + bn-lS -h bn _j^g 

-h aiS^~^ + * • • + Cln—lS -f- an 



(7.74) 



Example 7.3.1. Reconsider the high-order plant in Example 7.1.1. The output 
step response is first constructed using the IFFT. The area method (Rake, 1980) 
gives the model: 



G{s)^ 



2.15 

46.69s + l‘ 



-53.90s 



with err = 1.15 x 10 ^ and ERR = 60.87%. The FOPDT model estimated by 
our hybrid algorithm in this section is 



G(.) = 



0.0396 
s + 0.0184 ‘ 



-49.9839s 
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with err = 8.6 x 10 ^ and ERR = 48.12%. Our SOPDT model is 

\ _ - 28 . 8861 s 

^ ^ s2 + 0.0343s + 0.0005 

with err = 4.0631 x 10”^ and ERR = 5.81%. For a third-order plus dead time 
model (TOPDT), we have 

. 0.2059s^ -f- 0.0005s -f- 0.0001 oi qofic:^ 

= ;s Ta 996%^+ ' 6; o 382. + o.oooi ‘ ■ 

with err = 2.0009 x 10“^ and ERR = 1.27%. It can be seen that the results 
from our algorithm are consistently better than that of the area method. The 
estimation errors decrease with model order n. Especially from FOPDT to 
SOPDT, errors decrease dramatically, but the error decrease slows down from 
SOPDT to TOPDT. In this case, an SOPDT model is good enough. Step and 
frequency responses of the actual and estimated models are shown in Figure 
7.5. 



The proposed method is also tested for many other examples. Typical re- 
sults are given in Table 7.3. They show that consistent enhancement of the 
reduced-order model accuracy is achieved with the proposed method over the 
recursive least squares method of Section 7.1 if the latter starts with zero ini- 
tial parameters. The former does always preserve stability, as expected, while 
the latter is not capable of that. However, the recursive least squares method 
is simpler in implementation, and with those stability measures introduced in 
Section 7.1, the chance of getting stable models is quite high for low-order 
modelling, though not guaranteed. 
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(b) Frequency responses 



Fig. 7.5. Model reduction via hybrid algorithm 



( actual process; • • • area method; — — • — . proposed FOPDT; proposed 

SOPDT; * * * proposed TOPDT) 




Table 7.3. Summary of simulation results 
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8. A General Identification Approach 



Chapters 5 through 7 have covered in detail process frequency response esti- 
mation using relay feedback and conversion of frequency responses to transfer 
function models. The methods developed there are very useful in applications. 
There are, however, a few other issues which deserve attention. First, many 
industrial control systems already run in closed-loop before an identification 
test and/or controller retuning is carried out. In some cases, performing identi- 
fication experiments under closed-loop conditions may be necessary for safety 
or economic reasons, or if the system contains inherent feedback mechanisms 
(Forssell and Ljung, 1999). It is thus desirable not to disconnect the existing 
controller during the test. This gives rise to the closed-loop identification prob- 
lem, requiring that a test be conducted on a closed-loop system, but not on the 
process itself. 

Second, the types of test signals could be other than relay, say, pulse, pseudo- 
random binary sequence, step, ramp and sinusoidal functions (Unbehauen and 
Rao, 1987). Of all these tests, the step test is probably the simplest. The step 
test needs little equipment, can be performed manually and dominates in pro- 
cess control applications. Chapter 7 presented an algorithm for transfer func- 
tion identification from open-loop step responses. Its extension to closed-loop 
testing and multivariable systems is appealing. 

Third, most industrial processes are multivariable in nature. The control of 
such multivariable systems has always been a challenge due to its complex in- 
teractive nature. Control techniques such as model predictive control (Richalet 
et al, 1978) and internal model control (Garcia and Morari, 1982) explicitly 
require a process model. SISO identification techniques based on relay or step 
tests need to be modified to cope with multivaribale nature. 

There is thus a great demand for a general identification scheme for multi- 
variable systems that can cover many different experimental tests in a unified 
framework. In this chapter, a novel robust multivariable process identification 
method is presented. From the recorded process inputs and outputs, the fre- 
quency response matrix is calculated using the fast Fourier transform (FFT), 
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the step response is further constructed using the inverse fast Fourier transform 
(IFFT) and the transfer function is determined using an algorithm from Chap- 
ter 7, in an elementwise way. This method is applicable to any kind of test and 
pre-tuned controller regardless of the transient type, provided that the system 
is stable and the responses are not chaotic. We present the SISO version in 
Section 8.1 to motivate the general MIMO version in Section 8.2. Section 8.3 
deals solely with unstable processes, which necessitate a different technique. 



8.1 SISO Systems 

Consider the conventional feedback control system shown in Figure 8.1. The 
SISO process G{s) is under the control of the SISO controller K{s). 






K(s) 



G(s) 



Fig. 8.1. Feedback control system 



8.1.1 The Method 

The idea behind our method is to always estimate the process frequency re- 
sponse first, regardless of test type, and then to convert it to the step response 
from which a transfer function model can be obtained using an algorithm from 
Chapter 7. 

Test Suppose that a given process G{s) is stable and already runs in 
closed-loop with a pre-tuned controller K(s). Suppose that the system has been 
brought to a constant steady state. A test is conducted either in open-loop or 
closed-loop (user defined) so that a change in the manipulated variable u{t) for 
the open-loop test, or a change in the reference r(t), is activated. It should be 
pointed out that such a signal can be of any type. Suppose that the closed-loop 
system is stable and produces a steady state at the end of the applied test. The 
steady state can be a constant or some form of stationary oscillation. During 
the test, the manipulated variable u{t) and the process output y{t) are recorded 
until the steady state occurs. 
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Process Frequency Response In our method, except for an open-loop 
step test, for which this and the next steps are skipped, the frequency response 
of the process is first calculated. The open-loop relay test has been thoroughly 
discussed in Chapter 6. The analysis and techniques developed there are also 
applicable to other tests. The point to emphasize here is that the frequency 
responses Y{juj) and U(juj) of y{t) and u{t) cannot be obtained directly by 
taking the Fourier transform of these recorded y{t) and u{t). Here, we adopt 
a technique from Chapter 6, the decomposition method, and generalize it to 
cover all other tests, provided that the test yields a final finite steady state. 

Let y{t) and u{t), respectively, be decomposed into transient parts Ay{t), 
Au{t)^ and the steady state part or the periodic stationary cycle parts ys{t), 
Us{t) as 

y{t) = Ay{t) + ys{t), 



u{t) = Au{t) +Us{t). 

The definition of the transfer function gives 
^ U{s) Us{s) + AU{s)^ 



and the process frequency response is formally 



G(juj) = 



u,(jcj) + AU{jcj)' 



Note that AY{jui) and AU{ju) can be obtained using the Fourier transform 
since the transient parts Au{t) and Ay{t) decay to zero exponentially. In prac- 
tice, they are calculated using the FFT. Thus, it follows that 



G{juj) fa 



Ysjju) + TTT{Ay{t)) 
Us(juj) + J^J^r(Au{t)) 



( 8 . 1 ) 



If the test (say, a step test) gives a constant steady state output y{oo) we 
have 



YM 



yjoo) 

joj 



( 8 . 2 ) 



On the other hand, if the test (e.g. relay) causes stationary oscillations, it 
follows (Chapter 6) that 



1 

1 — 







YsiM = 



( 8 . 3 ) 
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where Tc is the period of the stationary oscillations in the process output 
Similarly, the following expression can be obtained: 



Us{ju^) 



u{oo) 

j(jJ ’ 



1 






step test; 
relay test. 



(8.4) 



With (8.2) or (8.3) and (8.4), the process frequency response can be calculated 
from (8.1). 

It should be pointed that the formula (8.1) assumes zero initial conditions. 
If the system has a nonzero operating point of 2/(0) and i/(0), then y{t)^ 2 /(oo), 
u{t) and u{oo) should be replaced by y{t) — 2 /( 0 ), y{oo) — 2/(0), u{t) — u(0) and 
u{oo) — ii(0), respectively. 

Construction of Process Step Response Imagine that the process 
input u{t) is a unit step function, then 

y(5) = G(s)l. (8.5) 

It seems very easy to obtain the corresponding y{t) by simply applying the 
inverse Fourier transform to Y{juo). However, since the the output response, 
2 /(f), is not absolutely integrable, such a calculation is meaningless as discussed 
in Chapter 7. To solve this problem, y{t) is decomposed into 



y(t) = y{oo) + Ay{i) = G{^)YAy{t). 



Applying the Laplace transform to both sides gives 

r(s) = ®+r{zi2/(t)}. (8.6) 

Bring (8.5) in, we have 



C{Ay{t)} = 



G{s)-G{Q) 



Applying the inverse Laplace transform yields 

Thus, using the inverse fast Fourier transform (IFFT), the process step response 
is constructed as 



y{i) « G(0)+IJFjrr(^^^^^t-^). 



(8.7) 



Process Transfer Function The stable step response constructed above 
is fitted into the following model: 
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Y{s) = G{s)U{s) = 



biS'^ ^-\-b2S'^ ^ bn 

s^ + aiS^-'^-i han-iS + an ^ ^ 



( 8 . 8 ) 



The algorithm in Section 2 of Chapter 7 is adopted here to obtain a stable G(s) 
from such a step response. No further discussion is needed. 



Remark 8.1.1. Compared with existing closed-loop identification methods, the 
proposed one is more robust because it makes use of all the recorded data. It 
can also be applied to a wide range of tests, and the controller is not limited 
to PID types only. Moreover, it can produce a general transfer function model, 
but is not restricted to first or second order. These advantages make it more 
appealing than its counterparts in many aspects. 



Remark 8.1.2. The combined use of the FFT and IFFT is crucial for enhance- 
ment of the identification performance. It looks possible and reasonable to esti- 
mate the process frequency response with the FFT and then obtain a transfer 
function using the response directly, say the recursive least squares method 
of Chapter 7. However, simple tests such as step or relay cannot excite the 
process effectively and uniformly over the whole working frequency range and 
the error in frequency response estimation varies with frequencies. This may in 
turn cause poor identification of the transfer function model. We find that the 
error inherent in the process frequency response with the FFT is neutralized 
or compensated for by the later IFFT, so that the process step response can be 
recovered accurately, which leads to a better transfer function model, as will 
be demonstrated in our simulation below. 



8.1.2 Simulation 

The proposed identification method is now applied to several typical processes. 
For better assessment of its accuracy, identification errors in both the time 
domain and the frequency domain are considered. This is because some closed- 
loop identification methods are found to be good in the time domain, but the 
frequency response of the model sometimes deviates too far from the real pro- 
cess frequency response. To achieve better control performance, the estimation 
error should be small in both time and frequency domains. 

The time domain identification error is measured over the transient period 
by standard deviation: 

1 ^ 

err=-Yyy{kT)-Um]\ 

^ k=l 



(8.9) 
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where y{kT) is the recorded output response of the actual process to a given 
test, while y{kT) is the output response of the estimated model under the 
recorded same control signal. The frequency domain identification error is mea- 
sured by the worst-case error. 



ERR = max 

i 



Gjjuji) - G{jui) 

G{jui) 



X 100%, 



i = ,M 



( 8 . 10 ) 



where G(jui) and G{juii) are the actual and estimated process frequency re- 
spouses respectively. ERR is evaluated over the frequency range with phase 
from 0 to — 7T, since this range is most important for control design. 

In practice, measurement noise is generally present. To examine the robust- 
ness of our algorithm against noise, noise is introduced into the output for these 
simulation studies. The noise level is measured by the following noise-to-signal 
ratio (Haykin, 1989): 

_ mean (abs (noise)) 
mean (abs (signal)) ’ 

Example 8.1.1. Consider a process 



e~ 

12s2 +8s-|- 1‘ 

Comparison is made with the method in Suganda et al. (1998) since it is the 
latest method available of its kind. In Suganda’s method, different sets of PI 
parameters are tested for these examples, which give different dynamics, corre- 
sponding to under-damping, median dampling and over-damping, respectively. 
For the different kinds of dynamics, different formulas are applied to give a 
transfer function for the closed-loop system. Since the proposed method is gen- 
eral and consistent for all these different scenarios, it is not necessary to test 
all these cases. Here, one sets the controller so as to give an under-damped 
response for the process; the other cases are shown for two extra processes in 
Table 8.1. 

G in this example is a second-order plus dead time (SOPDT) process, and 
should be estimated by a SOPDT model without model error in the noise-free 
case. A unit step is performed in closed-loop on the system with a PI controller 
{Kc = 0.4 and Ti = 2). Using the proposed method, the estimated SOPDT 
model is 



G(s) 



12.0643s2 + 8.0108s -h 1 ’ 




Table 8.1. Identification results 
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which is almost identical to the actual process. The identification errors are 
err = 4.91 x 10“^ and ERR = 0.35%. Under the same test condition, Suganda’s 
method gives the model: 

^ _ l.OOOOe-o^^^ss 

~ 12.0409s2 + 7.9810s + 1 ’ 

where the identification errors are err = 2.85 x 10“® and ERR = 0.45%. The 
improved accuracy is obvious, and this accuracy holds for other scenarios (see 
Table 8.1). 

It can be seen that Suganda’s method works well for those cases where 
the controller has been well tuned. It is possible that the controller is badly 
tuned. To test the effectiveness of the proposed method in such a situation, the 
following examples are presented. For these examples, there are no solutions 
using Suganda’s method. In fact, using their graphical method, complex coeffi- 
cients result when trying to find a SOPDT transfer function for the closed-loop 
system. 



Example 8.1.2. Consider a high-order oscillatory process with large dead 
time: 

(s + 1)2(2s + 1)3- 

The result from the proposed method is shown in Table 8.2, and the estimated 
model is very close to the actual process. Other examples are also shown in 
this table. 



Table 8.2. Identification results 



G(5) 


G(s) 


err 


ERR 


1.08e“^°^ 


1.08e"^2.8l5 


0.69 


2.14% 




7.54s^+5.26s + l 


-4s+l -5 


-3.985 + 1.00 -1.07s 


0.11 


0.82% 


9s2+2.4s + 1 


8.86s2+2.39s + 1*^ 


1 


1.00e“l-32« 


0.97 


9.28% 


(7+iF 


4.75s'^+3.28s + l 



Since the proposed method makes use of many points rather than one or 
two points on the process response and adopts a least squares or instrumental 
variable method, it is expected to be robust to noise. The identification results 
of the process with different noise levels are listed in Table 8.3, indicating that 
the proposed method works well even when there is large measurement noise 
present. 
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Table 8.3. Identification results with different NSR 



NSR 


G(s) 


err 


ERR 


0 


1.0801 -12.8110s 

7.5403s^+5.2612s+l ^ 


0.69 


2.14% 


3% 


1.0828 -12.6847s 

7.2238s‘-^+5.1499s + l ^ 


11.23 


3.44% 


5% 


1.0823 -12.5564s 

7.4893s^+5.1953s+l ^ 


21.44 


4.29% 


10% 


1.0808 -12.4387s 

7.6543s^+5.1754s + l^ 


42.08 


5.97% 


15% 


1.0794 -12.1350s 

8.4881s2+5.1712s + 1 ^ 


94.30 


9.67% 


20% 


1.0780 -11.9564s 

9.0539s2+5.2606s + 1 ^ 


131.98 


10.59% 


30% 


1.0908 -10.3358s 

15.5858s2+5.5866s + 1 ^ 


325.63 


24.35% 


40% 


1.0932 -10.6667s 

16.4593s^+4.9406s + 1 ^ 


572.71 


32.22% 




Fig. 8.2. Closed-loop response for G(s) = i 2 s^-^ 8 s-\-i NSR = 3% 



Example 8.1.3. To illustrate Remark 8.1.2, a step test is done for 



G = 



12 s 2 + 8s + 1 



with NSR — 3%. The response for the closed-loop system is shown in Figure 
8.2. Prom the corrupted output and control signal, the proposed method gives 



G{s) = 



1.0100 

11.3097s2 + 7.9830s + 1 



g-1.0144s 
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Fig. 8.3. Process step responses 

• — : actual process; : constructed using FFT and IFFT; : estimated 

model) 

The process step responses are shown in Figure 8.3, where the dash-dot line 
is for the actual process, and the dashed line is constructed from the FFT 
and IFFT method, while the solid line is from the estimated model with the 
proposed method. The effectiveness of the proposed method is clearly observed. 
It is also noticed that the constructed process step response using the FFT and 
IFFT techniques is very close to the actual one. Figure 8.4 shows Bode plots 
of the actual process (dash-dot line), the FFT-based estimation using (8.1) 
(dashed line) and the final model (solid line). The estimation error between the 
FFT-based approximation and the actual process is 77.77%, while that between 
the final model and the actual process is 3.08%. For this SOPDT process, the 
FFT gives a large approximation error in the high frequency part. However, 
accurate estimation is recovered after using the IFFT. 



8.2 MIMO Systems 

We want to extend the SISO method of the preceding section to the multivari- 
able case. Only square systems will be addressed. 
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T 

= [n(s) y2(s) Fm(s)] , 

input vector 

T 

[/(s) = [(7i(s) [/ 2 (s) f/m(s)] , 

and process transfer function matrix G = {Gij{s)}, i,j = 1,2, ••• ,m. The 
process may be in the feedback system depicted in Figure 8.1 with an m x m 
controller, K{s). For later use, partition the m x m identity matrix I as 



1 = 



Cl 62 • * • Cfn 



( 8 . 12 ) 



Similar to the SISO case in the preceding section, the idea of our MIMO method 
is to calculate the process frequency response G{juj) using the FFT, construct 
for each entry of G{s) its step response from Gij{joj) using the IFFT, and 
estimate a transfer function from such a response. But before these descriptions, 
we need to discuss the different tests to which our identification method is 
applicable. 

Test Some test has to be conducted on a given process to enable identi- 
fication. Various aspects of the test should be considered. The first is the type 
of test signal. The most popular are step and relay. The second consideration 
is the operating mode during the experimental test. It could be in open-loop 
mode without a controller or in closed-loop mode with a controller operating. 
The third consideration is how to configure the test for a multivariable process, 
as there could be three possible schemes: 

(i) Independent test: A test is applied to only one loop at a time and released 
once a steady state, i.e., constant steady state or stationary oscillations 
(Chen, 1993), is reached, and is repeated until all m tests on each loop 
have been performed. 

(ii) Sequential test: A test is applied to the first loop while all other loops 
are kept unattached. Then a test is made on the second loop while the 
previous change in the first loop is still in place. The procedure is repeated 
until the mth loop has been tested. 

(iii) Decentralized test: All m test signals are applied to m loops simultane- 
ously. 

Independent testing is quite time consuming since each test can be activated 
only after the process has been brought back to its original steady state follow- 
ing the previous test. Decentralized testing may generate complicated responses 
(Loh, 1994), which are difficult to analyze and predict. This has been addressed 
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in Chapters 5 and 6. The sequential test is thus considered in this chapter. With 
such a scheme there are four typical combinations of test: 

Case 1: Open-loop (sequential) step test; 

Case 2: Closed-loop (sequential) step test; 

Case 3: Open-loop (sequential) relay test; (8.13) 

Case 4: Closed-loop (sequential) relay test. 

Diagrams of open-loop and closed-loop sequential relay feedback tests are shown 
in Figure 8.5 and Figure 8.6 for illustration, respectively. It should be stressed 
that the identification method to be presented below is not restricted to these 
four cases only, but also applicable to other cases provided that each test leads 
to a steady state. 




Fig. 8.5. Open- loop sequential relay feedback Test 

To unify the presentation for all cases, we introduce a vector v{t): 

{ u{t), open-loop test, 
r{t), closed-loop test, 

where u{t) is the input to the plant and r{t) is the set-point for the closed- 
loop of Figure 8.1. Let l(^) and p{t) be a unit step function and relay function 
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Fig. 8.6. Closed-loop sequential relay feedback test 



with unity magnitude, respectively. The types of test signal are reflected by the 
elements of v{t): 



Vi(t) = 



ail(t), step, 
relay. 



(8.14) 



where ai and Pi are the size and amplitude of the step and relay, respectively. 
Then the m tests in a sequential experiment over the time span [to, tm] with 
respective test periods [ti-i,ti], i = 1, 2, • • • ,m, can be expressed as 



v{t) = 



v^{t) = Vi{t)ei, to-0^t<ti, 

= Vi{t)ei + ti-i ^t<ti,i = 2,3, - ,m, 



(8.15) 



where is the ith column of the m x m identity matrix deflned in (8.12), and 
to = 0 is the start time for the experiment while ti is the end time for the ith 
test when the system has entered the steady state. 

The sequential experiment on an m x m process is actually executed as 
follows: 

Initialization: Bring the process to constant steady states 2/(0) and u(0) at 
to = 0. Specify the step sizes at or the relay amplitudes /S^, i = 1, 2, • • • , m. 
Test 1: Apply a test of the given type and magnitude to the first input 
v\, while keeping all other inputs V{ unchanged, that is, Wait for 
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the system to settle down a,t t = ti, that is, the output y has reached a 
constant steady state during the step test or stationary oscillations during 
the relay test. 

Test i: Let u = u* as shown in (8.15) and apply it to the system at 
t = U-i, i = 2, 3, • • • , m, until the system settles down again at t = ti. 

Regardless of the different test cases (8.13), we always collect the process output 
and input responses from all m tests, and denote them by {u{t),y{t),t G [to^tm]}- 

Process Frequency Response This and the following steps of our 
method are to find the step response for every entry of the process transfer 
matrix. They are not required for Case 1 where such step responses are already 
available. It can be seen from (8.11) that if one has m independent output and 
input frequency response vectors Y^{ju) and W{juj), the process frequency 
response matrix G{ju) can then be obtained from the equation: 

[y^jw) - = G{juj) [u^jcj) ••• U^{juj)] ■ 

Our task now is to construct m independent time response vectors y^{t) and 
iT{t) from the recorded process output and input responses y(t) and u{t) such 
that for each i, y'^{t) and iT{t) have zero initial conditions at the start and 
steady states at the end, so that their frequency responses Y^{juj) and W{juj) 
meet Y^{juj) = G{juj)U^{juj). For Case 2 of a step test, the iih test starts 
usually with nonzero initial conditions y{ti-i) and u{ti-i), and ends with new 
constant steady states y{ti) and u{ti). If the output and input have their initial 
conditions subtracted, the resulting signals will have zero initial conditions at 
t = ti-i and constant steady states at t = ti. Thus we form from y and u the 
following modified signals: 

f{t) = y{t)-y(U^i), ti-i ^t <ti, i = 1,2,--- ,m, (8.16a) 

= u{t)—u{ti-i), ti-i ^t < ti, z = 1,2, • • • ,m. (8.16b) 

For experiments which lead to stationary oscillations (e.g.. Case 3 and Case 
4), making y{ti-i) = 0 only is not enough since its derivations could still be 
nonzero. Instead, let us imagine that for each z, the zth test lasts beyond t = ti 
until t — tm without activating the subsequent tests, then the last cycle of 
stationary oscillations y\{t) and u\{t) sustained before t = ti will be repeated 
until t = tm- One can thus define for each z 



y{t) -2/(0), 0^t<ti, 

yi{t)-y{0), ti^t^ tm, 



(8.17a) 
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and 



u\t) 



u{t) - ii(0), 0 < ti, 

ui(t) - 'ii(O), ti ^tm 



(8.17b) 



Note that in the step case and have different time spaces [ti-i,ti] while 
in the relay case they have the same space [0,^^]- 

Like the SISO case in the preceding section, decompose the responses into 
transient parts and steady state parts as 

y^{t) = Af{t)+yl{t), i = l,2, (8.18a) 

u\t) = Au'^{t)-\-ul{t), z 1,2, • • • ,m. (8.18b) 

For each i, y^{t) and u^{t) have almost entered the steady states at t = ti, 
and both Ay^{t) and Au^{t) are approximately zero afterwards. The Fourier 
transform of Ay'^{t) then gives its frequency response: 



AY 




oo 






In practice, (8.19) is approximated by 




Ay\t)e-^^^dt, 



(8.19) 



( 8 . 20 ) 



where the start time Vg and the end time are defined as 



t 



i 

s — 



Case 2, 

0, Case 3 or 4, 



and 



Case 2, 

tm, Case 3 or 4. 



(8.21a) 



(8.21b) 



(8.20) can be computed at discrete frequencies using the standard FFT tech- 
nique. 

For yl(t) and if the test (say, a step test) gives a constant steady state 
output, yl{ti), we have 



f-'Oc.) = 

3 ^ 



z = 1,2, • • • ,m. 



( 8 . 22 ) 
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On the other hand, if the test (e.g. relay) causes stationary oscillations, it 
follows that 

= 1 _ r (8.23) 

where Ti is the period of the stationary oscillations of yl . Similarly, the following 
expression can be obtained: 



uiijoj) = 



ui(ti) 

ju) ’ 

1 rU 

hi-Ti 



step test, 
dt^ relay test. 



(8.24) 



For each test i, it follows from (8.11) that the following frequency response 
relation holds: 



Y\ju) = G{jw)U\juj), * = 1, 2, • • • , m, (8.25) 

where 

r (jcj) = AY^ (ju) + Y: {juj ) , (8.26a) 

U\juj) = AU\ju^) + (8.26b) 

are obtained from (8.19)— (8.24). Collecting (8.25) for all i gives 

Y{juj) - (8.27) 

where 

Y{M = [y^Ulo) Y^jcj)-- - Y"^{juj)] , 

U{joj) = [u^(jcj) U^juj) ••• U^ijoj)] . 

If the inversion of U {ju) exists, the process frequency response matrix G{ju) 
can then be found from (8.27). The task now is to determine if U{ju) is invert- 
ible or not. 

For the closed-loop tests v = r (Case 2 or Case 4), it follows from Figure 
8.1 that 

U{s) = K(s)[/+Ar(s)G(s)]-ii?(s) = Q{s)R{s). (8.28) 

with nonsingular Q(s), or in the frequency domain, 

if {ju) = Q{ju)R{ju). (8.29) 



For Case 2, R{ju) is the frequency response of 
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r = 7^2 .. . ^mj 

— y.2 _ ^1 . . . ^ _ ^1 _ ^2 

= diag{ail(^)} 
and is given by 

Oii/juj 0 ••• 0 

0 a^/joj • • • 0 

R{ju) = 

_ 0 0 ••• am/joj 

which is nonsingular at any a; G (0, oo). C7 {juj) is thus invertible for oj G (0, oo). 
For Case 4, the nature of the sequential experiment (8.15) indicates that 

Pip{t)l{t) ^ip(^)l(^) 

0 2/ N ^2p(^)l(^-^l) 

, r^{t) = 

0 0 

hp{t)l{t - h) 
fimP{t)'^{t - tm-l) 

thus f = r'^ ... has an upper triangular form and so has its frequency 

response R{ju)). It then follows from (8.29) that U{juj) is nonsingular for w S 
[0,oo). 

Case 3 is an open-loop test with v = u. Like Case 4, its sequential nature 
gives an upper triangular U{ju), which is nonsingular for u G [0, oo). 

In view of the above analysis, all three cases (2,3,4) give an invertible U, so 
that the process frequency response can be calculated using 

G{ju) = [AY^jcj) + Y,\ju) ■ ■ ■ AY”^{3 u) + 57"(ia;)] 

■ \AU\juj) + U]{ju) • ■ • AU^iju:) + ' , (8.30) 

which is valid at all uj G [0, oo) for Cases 3 and 4, and at a; G (0, oo) for Case 
2. For a; = 0 in Case 2, we can determine the static gain of the process from 
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output and input steady states by 

<^(0) = ••• vTitm)] ••• ■ (8-31) 

Step Response Construction and Transfer Function Modelling 

Once the frequency response matrix G{juj) of the process is obtained, the step 
response of each entry can be constructed separately and can be used to obtain 
a transfer function which matches the step response best. These two steps are 
exactly the same as for the SISO case described in Section 8.1 and thus are not 
detailed here. Just do them in an elementwise way. 

Identification Algorithm We can summarize the above development 
into the following algorithm: 

Initialization: Bring the process to the constant steady states. Specify 
the test type (relay or step), their sizes and the test mode (open-loop or 
closed-loop). 

Step 1: Perform the sequential experiment and record all the process input 
and process output responses. 

Step 2: For Case 1, go to Step 4 directly. Otherwise, calculate the fre- 
quency response G{juj) from (8.30). 

Step 3: Construct the step response from (8.7), one for each entry G{juj). 
Step 4- Determine a transfer function model from the step response using 
the algorithm in Section 7.2 of Chapter 7, one for each entry G{s). 



8.2.2 Simulation 



In this subsection, the proposed identification method is applied to four typical 
industrial processes to show the effectiveness. Both time domain error, err as 
defined in (8.9), and frequency domain error, ERR as defined in (8.10), are 
evaluated for each entry of the model to assess estimation performance. 



Example 8.2.1. Consider the Vinante and Luyben plant (Luyben, 1986): 



G{s)^ 



-2.2e~- 

7s+l 



1.3e~ 



7s+l 






L 9.5S+1 



9.2S+1 



An open-loop sequential step test (Case 1) is applied. The model estimated 
with the proposed method is 



G{s) = 



7.0050S+1 7.0050S+1 

-2.8000e~^-^°°^^ 4.3000e~^-^^^'^^ ’ 

9.5050S+1 9.2050S+1 
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where the errors are 

3.7445 X 10-^% 0.9661% 

CTT — 

2.8127 X 10-^% 0.9690%J ’ 

and 



ERR = 



0.1709% 0.6973% 
0.1037% 0.5959% 



respectively, they are both very small. 



Example 8.2.2. Consider the 3x3 plant in Orgunnaike and Ray (1979): 



G{s) 



0.66e~^-^^ 

6.7S+1 

3.25S+1 

-34.68e~^-^^ 

8.15S+1 



8.64S+1 

-2.36e~^^ 

5s+l 

46.2e~^-^^ 

10.9S+1 



-0.0049e~^ 

9.06S+1 

7.09S+1 

0.87(11. 61s+l)e"^ 
(3.89s+l)(18.8s+l). 



An open-loop sequential relay feedback test (Case 3) is applied. According to 
(8.17a) and (8.17b), and u^{t) are constructed by duplicating the final 
cycles of their respective stationary oscillations before t = ti over t G 
Figure 8.7 shows the first output y\^ yf and yf. The proposed method is then 
applied to produce 



G(s) = 



Q.6600e~ 



-O.eiOOe" 



-0.0049e~ 



6.7074S+1 

1.1078e~^-^^^^^ 

3.1883S+1 

-34.6121e~^-^^^^^ 

8.0135S+1 



8.6487S+1 



9.0730S+1 



-2.3569e” 



4.9557S+1 



-0.0099e~ 



46.1028e~ 



10.8171S+1 



7.03025+1 

(9.81045+0.8684)e~^-^Q^^^ 
70. 7462s2-|-22. 26685+1 . 



with errors: 



err = 



1.0631 X 10-4% 1.6949% 1.3163% 
0.0045% 1.0160% 0.8386% , 

0.1585% 2.2145% 2.0277% 



and 



ERR = 



0.1031% 0.0898% 0.3450% 
0.7785% 1.0260% 0.6729% 
1.0572% 0.4151% 0.8779% 



respectively. The resultant model is almost identical to the actual process. 
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G(s) = 



11.4106S+1 

5.9975e~^-^^'^'^^ 

14.4527S+1 

2.3800e“°-^^®^^ 

2.0578S2+2.8695S+1 

474.9052s2+43.5817s+1 



0.3740e“'^’^^®®^ 

22.2658S+1 

-1.98496"°'^^°^^ 

66.6687S+1 

0.0204e“°-®®®^^ 
51.0132S2+14.2885S+1 
(-0.0051s-0.1760)e“°-®°^2^ 
47.7076s2 4-13.8112s+1 



-2.3678e~^^-^^^^^ 

33.3231S+1 



2999e~^'^^^®^ 

475.0586s^+43.5833s+l 



0.3993e~^-^^°^^ 5.2268e~^°'^‘*°^^ 

59221s2+471s+i 397.4322s+1 



0.5130e“^°°^^® 

1.0045S+1 



-0.3300e~°-^^^^^ 

5.6436s2+4.7611s+1 



15.5400e~^-Q°^^^ 

1.0049S+1 



4.4800e~^-^^^^^ 

11.1146S+1 



with the errors 



err = 



4.7829 X 10-4% 0.9211% 
0.1343% 1.1127% 

8.2181 X 10-3% 0.1204% 
0.0013% 2.4990% 



0.8915% 0.8239% 

1.8566% 2.8123% 

1.9589 X 10-3% 0.0738% 
0.3676% 1.4204% 



and 



ERR = 



0.5085% 0.2513% 0.0635% 0.7372% 
1.1258% 0.1598% 5.3791% 0.4579% 
0.6353% 0.1221% 0.5281% 0.3321% 
0.7047% 0.3921% 0.5328% 0.2944% 



respectively. The effectiveness of the proposed method is clearly shown. 



Example 8.2.4- Consider the well-known Wood/Berry (WB) binary distilla- 
tion column plant (Wood and Berry, 1973): 



G(s) 



12.8e~^ -18.9e~^^ 
16.7S+1 21s+l 

6.6e~'^^ -19.4e~^^ 



L10.9S+1 14.4S+1 J 

Suppose that the process is under the control of a decentralized PI controller 
(Luyben, 1986): 



K{s) = 



0.38 -H 2^ 0 

0 -0.075 - 2^ 



With the controller in action, a closed-loop sequential relay feedback test (Case 
4) is applied and the proposed method is used to give the estimated model: 




8.2 MIMO Systems 



229 



G(s) = 



12 . 8000 e“^°°°®^ 

16.7050S+1 



-18.9000e~^-^°°^^ 

21.0050S+1 



6.6000e~'^°°°®^ -19.40006“^°°°^^ 

10.9050S+1 14.4050S+1 



where the errors are 



0.000279% 0.1199% 
0.000287% 0.03411% 



and 



ERR 



0.1458% 0.0562% 
0.0563% 0.0639% 



respectively. 





Fig. 8.8. Bode plots for Gn with NSR=30% 

( plant; model; ’x’ FFT only; ’o’ Melo) 

To demonstrate robustness, the process is again tested under different noise 
conditions. For comparison, Melo’s method (Melo and Priedly, 1992) for the 
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Fig. 8.9. Bode plots for G 22 with NSR=30% 

( plant; model; xxx FFT only; 000 Melo) 

estimation of the process frequency response is also tested under the same 
conditions. The results are listed in Table 8.4. The robustness of the proposed 
method is evident. Figure 8.8 and Figure 8.9 show the Bode plots for Gn 
and G 22 of this plant with NSR = 30%, respectively, where the dashed line 
is for the actual plant, solid line for the model from our method, ’x’ for the 
FFT algorithm without further IFFT and transfer function modelling, and ’o’ 
for Melo’s method. As stated in Remark 8.1.2, the FFT alone gives a large 
approximation error in the high frequency part. However, accurate model is 
restored after using the IFFT and transfer function modelling. 



8.3 Unstable Processes 

The method presented so far uses step responses as an intermediate step. It will 
fail if the step response goes to infinity or the underlying process is unstable. 




Table 8.4. Identification results with different NSR 
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For unstable processes, we thus need a different technique for its identifica- 
tion. Consider an SISO unstable process. Suppose that some test like those 
mentioned in Section 8.1 is performed on it. The resulting input and output 
responses are recorded. They are employed to find a transfer function model 
for the process. 

Let an unstable process be represented by 



G{s) = 



^n— iS” ^ ^ + ... + biS + —Ls 

s” + + ... + ais + ao 



(8.32) 



or equivalently by 



+ . . . + aiy^^\t) + aoy{t) = 

- L) + bn-2U^'^~^\t - L) + . . . + biu^^\t - L) + bou{t — L), 

(8.33) 

where L > 0. 

For an integer m ^ 1, define 

r(m) rt pTm 



pym) nt pTm pT2 

/ h= / • • • / h{ri)dri • • • dr^. 

J[o,t] Jo Jo Jo 



Under zero initial conditions, if the time delay L is known, integrating (8.33) 
n times gives 

n{l) A2) rin-l) An) 

y(t) = -Un-i / y- an -2 / V CLi y~ao y 

J[0,t] J[0,t] J[0,t] J[0,t] 

r(i) /*(2) r(^) 



Ml) M-Z) nn-i) MU) 

Un-1 I U bn-2 I U • • • + 6l / U -\- bo I U. 
J[0,t-L] J[0,t-L] J[0,t-L] J[0,t-L] 



(8.34) 



Define 



7 (i) = y{t), 

A {t) = [- /[oj] y, ■■■ , - y, /[o,]_x] w, 
= [on-l, ■ ■ • , do, bn-1, • • • , to] • 

Then (8.34) can be expressed as 

7(t) = <jF{t)9, if L. 

Choose t = ti and L ^ti <t 2 < ■ • ■ < Then 



n 



(8.35) 



r = ^e 



(8.36) 
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where T = 7 (^ 1 ), 7 (^iv)] , and # = 4 >{t 2 ), <A(tjv)] • 

In (8.36), the 6 which minimizes the following equation error, 

mmir-^efir-rn), 

is given by the least squares solution: 

9 = (8.37) 

Note that the above algorithm requires the unknown time delay L to be 
estimated. One way of solving this problem is to find the optimal solution of 
the parameters in (8.32) over the possible range of L. This is a one-dimensional 
search problem and can easily be solved if an estimate of the range of L is given. 
A reasonable search range L is 0.5 2.0 times Lq, which is the estimated L in 

the FOPDT model, and we evaluate 15 20 points in that range to find the 

optimal estimate L. 

Simulation has been carried out on a number of processes to illustrate the 
identification algorithm. The identification results of different processes under 
different noise levels are given in Table 8.5, indicating good accuracy and ro- 
bustness for the proposed method. 
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Table 8.5. Transfer function modeling 



Process 


NSR 


Model 


err(%) 




0% 


3.9902 ^-2.05 

-3.98485 + 1.0000^ 


1.03 


4e-2- 

-4s+l 


15% 


4.0160 ^-2. Os 

-4.02305+1.0000^ 


5.06 




30% 


4.0480 ^-2.0s 

-4.0567S + 1.0000 ^ 


9.32 




0% 


1.0042 -0.50s 

(-2.0285s + l)(0.5119s+l) ^ 


3.6 


g-0.5. 

(-2s + l)(0.5s + l) 


15% 


0.9947 -0.49s 

(-2.1186s + 1.0000)(0.4782s+l) ^ 


6.7 




30% 


0.9903 -0.49s 

(-2.2157s + 1.0000)(0.4719s+l) ^ 


19.7 




0% 


0.9985 -0.50s 

(-5.0097s + l)(1.9853s + l)(0.5062s + l) ^ 


4.5 


^-0.55 

(-55 + 1)(2s + 1)(0.5s + 1) 


15% 


0.9942 -0.49s 

(-5.1006s + l)(1.7913s + l)(0.5239s + l) ^ 


9.7 




30% 


0.9942 -0.49s 

(-5.1507s + l)(1.6653s+l)(0.5754s + l) ^ 


25.25 




Part III 



Controller Design 




Introduction to Part III 



A process model can be used for system analysis, prediction, design, control, 
optimization, management and so on. In the context of model-based control 
system design, there is a large domain of techniques such as pole placement, 
robust, optimal, and adaptive control approaches. They are usually state-space 
based. Their specifications are generally quite different from those used in pro- 
cess control. Time delay is frequently encountered in process control, while the 
state-space based approach usually cannot handle time delay easily. The de- 
coupling requirement, which is very important for process control, is usually 
not considered explicitly in state-space based approaches. This explains the 
discrepancy between the many well-developed state-space based multivariable 
designs (i^oo ? LQG, ...) and the rare use of them in process control. 

High performance is always the design target in industrial control applica- 
tions. During the last two decades, model predictive control (MFC) has emerged 
as a powerful practical control technique in industry due to its ability to com- 
pensate for process dead times and include input and output constraints in 
the formulation of the control law through on-line optimization. Among the 
MFC techniques is the so-called internal model control (IMG) (Morari and 
Zafiriou, 1989). The idea inherent in IMG has been around in one form or an- 
other for several decades. As early as 1957, Newton et al. (1957) converted the 
closed-loop design problem into an open-loop problem and thus circumvented 
the closed-loop stability issue, just as is done in the IMG. The Smith predictor 
(Smith, 1957) contains the reference model idea of the IMG. The IMG struc- 
ture was formally introduced by Garcia and Morari (1982). It is a powerful 
control design strategy for linear systems (Garcia and Morari, 1982; Rivera et 
al, 1986; Morari and Zafiriou, 1989). It uses the process model as the internal 
model to predict the process output. When the model is perfect, the IMG sys- 
tem becomes an open-loop system and controller design and stability analysis 
issues become trivial. When a model mismatch exists, by appropriately modify- 
ing the difference, robustness can be obtained. The IMG enables the transient 
response and robustness to be addressed independently. Single-loop control and 
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most of the existing advanced controllers such as the linear quadratic optimal 
controller and the Smith predictor can equivalently be put into the general IMC 
form (Garcia and Morari, 1982; Fisher, 1991; Zhu et al, 1995). The advantages 
of IMC are exploited in many industrial applications (Garcia and Morari, 1982). 

It is, however, noted that by far the most widely used controllers in the 
process industries are PID controllers, so it is worth exploring the relationship 
between IMC and PID in order to gain insight into the tuning of this sim- 
pler controller, its performance and limitations. Note that for a process whose 
Nyquist curve exhibits a strange shape, especially around the crossover fre- 
quency, a PID controller could be difRcult to shape satisfactorily. What one 
can do is de-tune the PID controller by trading off some performance to a suf- 
ficient extent to generate a stable closed loop if the original process is stable. 
But, this necessarily results in sluggish response and poor performance, which 
may not be desirable. A general, probably high-order single-loop controller is 
then necessary for high performance and it would be nice to design it from 
IMC and know when PID is not adequate. Another issue to notice is that there 
are many multivariable processes in reality. Though individual channels of such 
processes could be quite simple, such as first-order plus dead time dynamics, 
multivariable interactions might cause equivalent single loops to be very difR- 
cult to compensate for, especially when the number of inputs/outputs is large. 
Therefore, more effective design is needed. 

In our recent developments in control design (Wang et al, 1997a; Wang et 
a/., 20006; Wang et a/., 2001a; Wang et aL, 2001c; Wang et a/., 2002) to be 
presented in this part, a unified framework is established to design either IMC 
or PID or general single-loop controllers for SISO and MIMO systems with 
possible time delays. Time delay and non-minimum-phase zeros which must be 
present in and impose performance limitations on closed loops are first charac- 
terized, and the IMC control system with best achievable performance under 
given uncertainties and manipulated variable limits is then designed. Its single- 
loop controller approximation is determined by an algebraic operation and 
model reduction and is usually not in PID types. If PID is preferred by users, 
its parameters are tuned (may be de-tuned automatically if necessary) also 
using model reduction with possible sacrifice of the closed-loop performance. 
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The internal model control (IMC) is a powerful framework for control system 
design and implementation (Morari and Zafiriou, 1989), and it has sound the- 
oretical foundation. Its stability analysis is extremely easy to carry out and 
the design trade-off between performance and robustness is clearly understood. 
It has attracted the attention of industrial users because there is only one 
user-defined tuning parameter, which is directly related to the closed-loop time 
constant or equivalently, the closed-loop bandwidth. On the other hand, the 
vast majority of controllers being used in industry are of the PID type due to its 
simplicity and popularity (Astrom and Hagglund, 1995). Recently, great efforts 
have been made to develop PID tuning strategies for more general processes 
(Barnes et al, 1993; Sung and Lee, 1996; Sung et al, 1996; Datta et aL, 2000). 
Each method was derived for its particular optimization objectives and plant 
model assumptions, and therefore performs well only for its own class. It is 
common that practising control engineers may not be certain which tuning 
method should be chosen to provide good control in a given process. It would 
hence be desirable to develop a design method that works universally with high 
performance for general stable linear processes, and is capable of producing a 
high-order controller when the PID controller is no longer adequate. 

This chapter presents a unified framework for control system design. The 
IMC controller is always designed first. If the IMC scheme cannot be imple- 
mented, the equivalent controller in a conventional unity output feedback con- 
figuration is derived from the IMC controller and simplified by model reduction 
to a realizable controller, whose structure can be specified by users as a PID 
type or general rational function type to suit real situations best. In this chap- 
ter, we exclusively consider stable processes except the last section where the 
method is extended to unstable processes. 




240 9. Single- variable Systems 



9.1 Design Methodology 

The schematic of the IMC system is depicted in Figure 9.1, where G{s) is 
the given stable process to be controlled, (5(5) a model of the process and 
C{s) the IMC primary controller. The design procedure for IMC systems is 




Fig. 9.1. IMC control system 



well documented (Morari and Zafiriou, 1989), and highlighted as follows. The 
model is factorized as 

G(s) = G+(s)G_(s), (9.1) 

such that (5+ ( 5 ) contains all the dead time and right half-plane zeros of G{s): 

G+(s) = Re (ft) > 0, (9.2) 

i 

while G-{s) is stable and of minimum phase with no predictors. The primary 
controller takes the form: 

C = GiV, (9.3) 



where / is a user-specified low-pass filter and usually chosen as 



f{s,T) 



1 

{ts + 1 )"^ ’ 



(9.4) 



where m is sufficiently large to guarantee that the IMC controller C is proper, 
r is the only tuning parameter to be selected by the user to achieve the ap- 
propriate compromise between performance and robustness and to keep the 
action of the manipulated variable within bounds. A smaller r provides faster 
closed-loop response but the manipulated variable is moved more vigorously, 
while a larger r provides a slower but smoother response. A larger r is also 
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less sensitive to model mismatches. In process control practice, the closed-loop 
bandwidth oocb can rarely exceed ten times the open-loop process bandwidth 
Ljpb (Morari and Zafiriou, 1989), i.e., ujcb < lOcjpt. Usually, the desired closed- 
loop bandwidth is chosen as ujcb = l^pb, 7 ^ [0.5,10]. Using (9.4), it can be 
readily seen that 



V V2- 1 

r = 

J(^pb 



7 e [0.5, 10], 



(9.5) 



In the case of model uncertainty, r should be increased just enough to meet the 
condition for which the system is robustly stable (Morari and Zafiriou, 1989). 

In order to keep the action of the manipulated variable within bounds, 
we use a frequency-by-frequency analysis (Skogestad and Postlethwaite, 1996). 
Assume that at each frequency \U{j(jj)\ < U and |i?(ja;)| < R. The manipulated 
variable meets 

U{s) = C{s)R{s) = j—^^GZ\s)R{s). 



One requires 

—-^——G-'^(juj)R(juj) < U. 

{rju + 1)"* ^ ^ - 

Consider the worst case of \R{juj)\ = R, and we require 



(9.6) 



{rjuj + l)’^ 



< 



G-ijuj) 



U 

R' 



(9.7) 



To derive an inequality on r imposed by input constraints, let a; = Uob^ where 



ujob is the open-loop bandwidth, and notice that 



G — {joJob) 



= we have 



1 

{rjcoob + 1 )"" 



< 

- V2R’ 



I.e., 



r > 




1 



^ob' 



(9.8) 



(9.9) 



We choose r to meet (9.5), (9.9) and any possible robustness specification. 
Then, the IMC control system has been designed and can be implemented 
according to Figure 9.1 with the controller in (9.3). To see performance for the 
case of no plant-model mismatch, the nominal closed-loop transfer function of 
the IMC system between the set point r and output y is 
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i?=G+/=(nfr4?); 



r.-Ls 



(9.10) 



If a user prefers a conventional (or single-loop) feedback control configura- 
tion, instead of the IMC scheme, for whatever reason, we can derive a controller 
for such a configuration from the IMC controller. This involves two issues. One 
is to convert the IMC system to an equivalent single-loop system. The other is 
to de-tune the IMC controller parameter to refiect the difference between the 
two control schemes and thus achievable performance limitations so that the 
performance from the properly de-tuned IMC system can be achieved by its 
single-loop (SL) equivalent. 




Fig. 9.2. Single-loop control system 



The IMC system in Figure 9.1 can be formally redrawn into the equivalent 
single-loop (SL) feedback system in Figure 9.2, if the SL controller K is related 
to the IMC controller C via 
C(s,r) 



K{s,t)^ 



1 - G{s)C{s,t) 



(9.11) 



In Chien (1988), K is chosen as the PID type, and the value of r is set ac- 
cording to (9.5) as if the single-loop PID controller could achieve the same 
performance as that of the more complex IMC controller. The dead time is 
approximated by either a first-order Pade or first-order Taylor series, and the 
PID controller parameters are obtained by matching the first few Markov co- 
efficients of (9.11) for the selected specific process models. The results are listed 
in Table 9.1. However, it is noted that the use of the Pade approximation or 
a first-order Taylor expansion introduces extra modelling errors. Furthermore, 
Chien’s rules are applicable only to first-order plus dead time (FOPDT) and 
second-order plus dead time (SOPDT) processes. This inevitably restricts the 
general applicability of the method and the performance of the resulting con- 
troller. 

Our IMC-based design methodology described here can yield the best single- 
loop controller approximation to the IMC controller regardless of process order 
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Table 9.1. Chien’s IMC-PID rules 



Process model 


kckp 


Ti 


Td 


kps~^^ 

1+ris 




Tl 


- 


kp(rss-\-l)e~^^ 
(ri5 + l)(T2S+l) 


T^ +T2-T3 

t+L 


n +T2 — Ts 


T2-(ti +T2 - T3 )t3 
Tl-hT2-T3 


kp{-T2S-\-l)e~^^ 






rail 1 I1Z2 


(ris + l)(T2S + l) 


t+tz+L 


T1+T2+ 


kp6~^^ 

s 


2r±L 

(r+i)^ 


2t + L 


- 



and characteristics. The resulting single-loop performance can be better guar- 
anteed and well predicted from the IMC counterpart. Our design idea is very 
simple: given the equivalent single-loop controller K in (9.11), which may be 
unnecessarily complicated to implement, apply a suitable model reduction to 
obtain the best approximation ^ to K. If the user specifies the type of K 
(say, PID), then the model reduction algorithm will generate its parameters. If 
the approximation accuracy is satisfactory, the design is completed; otherwise, 
the algorithm will adjust the IMC controller performance until its single-loop 
approximation is satisfactory. On the other hand, if the user has no preferred 
controller structure, our algorithm starts with a PID type, and gradually in- 
creases the controller complexity such that the simplest approximation K is 
attained with the guaranteed accuracy to K. This allows a unified treatment 
of all cases and facilitates auto-tuning applications. 

A crucial issue in IMC-SL controller design is to get a suitable value for r 
which leads to a good single-loop controller approximation to the corresponding 
IMC one. Note the inherent difference between IMC and SL systems in their 
configurations (Figures 9.1 and 9.2) where the former has output prediction 
while the latter does not. In fact, not all IMC systems can be approximated 
reasonably by single-loop systems (see the remark at the end of Section 9.3). 
The r given by (9.5) is suitable for IMC systems, but it does not consider the 
performance limitations of single-loop feedback systems due to non-minimum- 
phase zero and dead time. Such limitations are usually expressed by integral 
relationships (Freudenberg and Looze, 1987). Recently, Astrom (2000) proposed 
the following simple non-integral inequality for the gain crossover frequency uJog 
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of the open-loop transfer function GK^ where 

\G{jUJog)K{jUog,T)\ = 1, (9.12) 

to meet 

axgG+{jujog) > ~'^S0°+<t>m-^gG-{j0Jog)K{juJog,T), (9.13) 

where 0rn is the desired phase margin. The selection of (j)m reflects the control 
system robustness to process uncertainty (Astrom, 2000): large (f)m is required 
for large uncertainty. With a lack of information on uncertainty size, a typical 
range for (j)m would be 30°-80°. Our design objective is to achieve a non- 
oscillatory response as specifled by (9.10) and yet have the response as fast 
as possible. This translates to a damping ratio of approximately ^ = 0.7, and 
the empirical formula (j)m = 100^ (Franklin et a/., 1990) yields an estimate of 
(j)^ = 70® for ^ = 0.7. Our studies suggest that (prn = 65® is usually a good 
choice and we use this (j)m throughout this chapter. With (j)m specifled, we then 
And the smallest r* which satisfles (9.12) and (9.13). 

In short, for single-loop controller design the tuning parameter r in the 
Alter (9.4) should be, in general, chosen to meet (9.5), (9.9), (9.12) and (9.13) 
simultaneously. If the process is of minimum phase, (9.12), (9.13) vanish, while 
(9.5) and (9.9) are in action. On the other hand, if the process has any non- 
minimum element, our study shows that the r derived from (9.9), (9.12) and 
(9.13) always appears in the range given in (9.5) so that (9.9), (9.12) and (9.13) 
would be enough to determine r in this case. In the subsequent two sections, 
PID and general controllers are considered in detail. 



9.2 PID Controller 

Owing to its simple structure, the PID controller is the most widely used con- 
troller in the process industry, even though many advanced control algorithms 
have been introduced. Consider a PID controller in the form: 

KpiD = kp + ^ + kdS, (9.14) 

where kp is the proportional gain, ki the integral gain (units of time), and kd the 
derivative gain (units of time). Our task is to And the three PID parameters, 
so as to match K = Kpjo to K = well as possible. This objective 

1— GO 

can be realized by minimizing the loss function. 
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M 

min J = min fep, h, kd > 0, (9.15) 

KpiD KpiD 

^=l 

whose solution is obtained by standard non-negative least squares to give the 
optimal PID parameters as j^Aj* == 0* . Our studies suggest that the 

frequency range [u;i, ujm] in the optimal fitting (9.15) be chosen as uOch) 

with steps of ~ where ujcb is the desired closed-loop bandwidth. 

Once a PID controller is found, the following criterion should be used to 
validate the solution: 



ERR = max 

c*^G[0,a;cb] 



kiM-KjjLj) 

K{ju) 



< e, 



(9.16) 



where e is the user-specified fitting error threshold, e is specified according to 
the desired degree of performance, or accuracy of the SL approximation to 
the IMC one. Usually e may be set as 3%. If (9.16) holds true, the design is 
complete. 

On the other hand, if the given threshold cannot be met, one can always 
detune the PID controller by relaxing the IMC specification, i.e., increasing r. 
A typical relationship between the tuning parameter r and the approximation 
error is shown in Figure 9.3. In general, ERR decreases as r increases. It pro- 
vides a simple way to select a minimum r with respect to the specific accuracy 
threshold. In practice, however, it is inconvenient to draw such a curve. It is 
found that the decreasing rate d{ERR)/dr is highly influenced by plant dead 
time L and the right half-plane (RHP) zeros which limit the achievable 
bandwidth, ujch is virtually unaffected by the presence of the filter (Rivera et 
al., 1986) until r reaches an order of magnitude comparable to L and re- 
spectively. Hence, it is effective and efficient to choose the increment of r in 
the PID detuning procedure as the maximum of L and Re Pi, i.e.. 



max (L, min (Re (^^i))) (9-17) 

i 

where k represents the kth iteration, and r] is an adjustable factor reflecting the 
approximation accuracy of the present iteration and is set at | and 1, when 
3% < ERR < 20%, 20% < ERR < 100% and 100% < ERR, respectively. The 
iteration continues until the accuracy bound is fulfilled. 

Our detuning rule for r in (9.17) implicitly assumes that ERR would be 
sufficiently small when r is large enough. In this connection, it would be inter- 
esting to see if lim ERR = 0. Equation (9.5) can be rewritten as 

r— foo 

V V2- 1 



^cb — 



r 



(9.18) 
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Fig. 9.3. Relationship between filter parameter (r) and approximation error (ERR) 



When T increases to infinity, it is easy to see from (9.18) that lim Ucb = 0, 

T—^OO 

G{j(jj) can be replaced by G(0) for uj < ujcb, and K becomes • 

For m = 1, K = ^ is a pure integrator and can be realized precisely 

by a PID controller with no error. In general, the Nyquist curve of K{juj) for 
UJ e (0, ujcb) approaches a straight line as shown in Figure 9.4, when r tends to 
infinity. Note that the Nyquist curve for the PID controller is always a vertical 
straight line, and can match that of K{juj) as well as desired for r oo. One 
thus expects ERR to converge to 0 as r approaches infinity. 

We now present some simulation examples to demonstrate our PID tuning 
algorithm and compare it with the original IMG and the PID tuning in Chien 
(1988). Chien (1988) implemented the following PID form: 



Tis + 1 

where the PID settings are given in Table 9.1. The ideal PID controller in 
(9.14) used for our algorithm development is not physically realizable and thus 
is replaced by 



KpiD = fcc + — + 
s 



kdS 

^s + l' 



(9.19) 
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Fig. 9.4. Nyquist curve of K up to ujch {fn = 3) 

. -T = 0.1, T = 0.3, r = 1) 

In both cases, N is suggested to be chosen in the range [5,20]. Simulations 
are done under the perfect model matching condition, i.e., G = G (model 
mismatch will be considered in Section 9.4). To have fair and comprehensive 
assessment of controller performance, most performance indices popularly used 
in process control are measured and they include both time domain ones such as 
percentage overshoot (Mp), rise time (from 10% to 90%) in seconds (tr), setting 
time (to 1%) in seconds (tg), integral absolute-error (lAE = \r — y\dt where 
the upper limit oo may be replaced by T, which is chosen sufficiently large so 
that e{t) ioT t > T is negligible); and frequency domain error ERR defined 
in (9.16). Simulations were made for three typical plants, and the results are 
shown in Table 9.2. 

Example 9.2.1. Consider a first-order plus dead time process: 

^-0.5s 

G = —^- 

s + 1 

From (9.9), (9.12) and (9.13), one can readily find r* = 0.3333. Then, Chien’s 
formula gives a PI controller, 

kpi = 1.2029(1 + 1 ), 

S 




Table 9.2. Simulation results for stable processes 
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while the proposed method yields 



. .nnr 1*2050 0.18565 

Kpid = 1.40 05 + — - — + 0.1856 1 > 

* S -r i 



which achieves the specified approximation accuracy ERR < 3%. The Ziegler- 
Nichols step response tuning method (Ziegler and Nichols, 1942) gives 



Kpi-zN = 2.64(1H h 0^ 



s ^5 + r 



while the Cohen-Coon step response method (Cohen and Coon, 1953) produces 

r. _ o .on , 0*9430 , 0.17035 

Kpi-cc - 3.22(1 + — y -+ o ^ 

The closed-loop responses for different designs are shown in Figure 9.5. It 




can be seen that both Chien’s rule and the proposed method show much better 
performance than the conventional ZN and CC designs. The proposed method 
is almost identical to the IMC system. 
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Example 9.2.2. Consider a process with right half-plane zero: 

(-0.5s -h l)e-* 

(s + l)(2s + 1) ■ 

From (9.9), (9.12) and (9.13), one gets r* = 0.6687, which gives rise to 

r> , 0-3111 0.8365s , 

KpiD = 1.3779(1-1- -F 0.8365 - , J 



0.8365 

N 



5 + 1 



by Chien’s formula, and 



0.3569 0.97655 

KpiD = 1.1194 + + 



0.9765 

N 



5 + 1 



by the proposed method with ERR < 3%. The closed-loop responses are shown 
in Figure 9.6. 





Fig. 9.6. Comparison of set-point responses for 

proposed PID, • • • Chien, IMG) 



Example 9.2.3. Consider a high-order and oscillatory process: 
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Q _ 

(5^ + S + 1)(5^ + 0.6s + 1) ’ 
Our method produces r* = 0.6687 and 



^ 0-2139 

KpiD — 0.2860 H h 

s 



0.3962s 



0.3962 ^ _L 1 
N ^ 



(9.20) 



This controller has the approximation error ERR = 17.46%, which cannot fulfil 
the accuracy threshold, and the closed-loop response is very poor, as shown in 
Figure 9.7. Then r is adjusted to + 0.25L = 0.6687 + 0.5 = 1.1687 





according to the proposed tuning rule (9.17). The new r results in 



KpiD = 0.1016 + 



0.1498 

s 



+ 



0.1229s 



(9.21) 



The approximation error ERR of the proposed method has met the specified 
approximation accuracy ERR < 3%. The closed-loop responses are shown in 
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tire 



Fig. 9.8. Set-point responses for ^ ^ with r = 1.1687 

(—• — • — proposed PID, IMC) 

Figure 9.8. One observes that the difference between our SL system and the 
original IMC system is not discernible. 

It can be seen from the simulation study in Table 9.2 that the proposed 
method always yields a PID controller that is a much better approximation 
to the IMC counterpart than Chien’s method, regardless of what r is chosen. 
Our experience indicates that for FOPDT and SOPDT processes and a slow 
closed-loop response requirement of r > ^ , both the proposed IMC-PID 

method and Chien’s rules generate responses close to the IMC counterpart. 
In particular, the proposed method can always achieve ERR < 3%, and thus 
the closed-loop performance can be well predicted from the corresponding IMC 
system. However, when fast closed-loop response, generally (jJcb > i*e., r < 

^ ? is required, the proposed method shows significant improvement over 
Chien’s rules. The improvement is also evident for complex processes with slow 
responses. Moreover, under the fast response requirement, ujcb > (^pb, the PID 
controller derived from Chien’s rules may cause large peaks in the manipulated 
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variable, which is harmful to the system. It is, however, noticed that for high- 
order processes with fast responses, none of the above two IMC-PID methods is 
able to generate PID systems similar to IMG ones. This implies that a controller 
in the PID form is insufficient to obtain the desired performance. In this case, a 
higher-order controller has to be considered for better fitting and performance, 
which will be discussed in the next section. 



9.3 High-order Controller 



If the single-loop controller is not limited to PID type and if PID is not adequate 
to control a given process, we have to consider a general type of proper rational 
function controller to meet the specifications. The task at hand is then to find 
an nth-order rational function approximation: 



bnS^ + bn 



-h ... + bis + 6o 



-h Un-lS^ 



(9.22) 



with an integrator such that 






is minimized. The problem can be solved by one of two algorithms for transfer 
function modelling from frequency response presented in Chapter 7. If the 
recursive least squares methods (RLS) there is adopted, like the LS algorithm 
in the preceding section, the frequency range for the RLS is also chosen as 
(0.1o;c6, ^cb) with steps of ^ 

From the typical relationship of the relative fitting error ERR defined in 
(9.16) and the rational approximation order n shown in Figure 9.9, we can 
see that ERR decreases, as n increases. We try to find the minimum n which 
achieves the approximation bound ERR < e with a user-specified r. In general, 
if faster response is required, a higher-order controller has to be used. 

The above algorithm deals with the problem of approximating a given, prob- 
ably non-rational, transfer function by a rational function. Error bounds for 
such an approximation have been investigated (Wahlberg and Ljung, 1992; Yan 
and Lam, 1999). Wahlberg and Ljung (1992) proposed an approach based on 
weighted least squares estimation, and provided hard frequency-domain trans- 
fer function error bounds. However, it is not easy to calculate such a bound, 
and the convergence of estimation has not been addressed. In our work, we 
use a maximum likelihood index ERR to evaluate the approximation accuracy. 
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1 2 3 4 5 6 7 8 



n 

Fig. 9.9. Relationship between order n and approximation error ERR 



and assume that the accuracy threshold can be achieved when the controller 
order is high enough. 

When r is chosen, we first find the PID controller using the standard least 
squares method and evaluate the corresponding approximation error ERR in 
(9.16) as described in the preceding section. If ERR cannot achieve the specified 
approximation accuracy e (usually 3%), we recommend a high-order controller 
as in (9.22), and start with a controller of order 2 up to the smallest integer n 
such that ERR < e. 

Tuning procedure 

Step 1. Find the smallest r* from (9.9), (9.12) and (9.13), and let = r*. 
Step 2. Determine the PID controller from (9.15) and evaluate the correspond- 
ing approximation error ERR in (9.16). If ERR achieves the specified 
approximation accuracy e (usually 3%), end the design. 

Step 3. Otherwise, we have two ways to solve this problem: if a PID controller 
is desired, update r by (9.17), and go to Step 2; else, go to Step 4. 
Step 4. Adopt the high-order controller in (9.22), start with a controller of 
order 2 up to the smallest integer n for which ERR < e. 
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Example 9.2.3 (cont’d). Reconsider 

Q — 

+ 5 + 1)(52 Q 05 _|_ ’ 

for which = 0.6687 and a PID has been obtained with ERR = 17.46%. For 
a high-order controller, our procedure ends with 

^ _ 3.5488s^ + 14.9135s^ + 23.9669s^ + 29.6333^2 -h 18.2712s + 9.2024 
s^ + 4.5140s4 -h 25.8787s3 -h 22.8686s2 -h 43.0211s 

(9.24) 

with fitting error ERR less than e = 3%. The closed-loop step responses are 
shown in Figure 9.7, and their performance indices are also given in Table 9.2. 
We can see that the new controller K restores the IMC performance, while 
the previous PID controller in (9.20) is not capable of that under such a tight 
performance specification. 

If r is chosen to be smaller than the value suggested by (9.9), (9.12) and 
(9.13), this overcomes the limitation of single-loop feedback systems, but then 
no single-loop controller solution with stability could be found for the corre- 
sponding IMC system. For instance, in the above example, choosing r 50% 
less than r^, i.e., r = 0.3344, we could not find a controller in the form of 
(9.22) with ERR less than 3%, which implies that SL controllers are unlikely 
to achieve a performance tighter than that specified by (9.9), (9.12) and (9.13). 

It is observed from our simulation study that usually, the approximation 
error magnitude of the high-order controller obtained by the RLS is of the or- 
der 10“^ or less, the controller order is less than 6, and the controller yields 
a closed-loop response very close to that of the IMC loop provided that r is 
set by (9.9), (9.12) and (9.13). The high-order controller does provide signifi- 
cant performance enhancement over PID for complex processes. The proposed 
method is a simple, effective, and efficient way to design such high-performance 
controllers. 



9.4 Stability Analysis 

From the results obtained so far, it is possible to state that the single-loop 
system with K derived using the proposed method has a performance close 
to the corresponding IMC loop. Thus the stability of the resulting single-loop 
control system is well related to that of the IMC system. In this section, we 
consider both nominal stability [G = G) and robust stability {G ^ G). 

Assume G = G in the absence of model uncertainty, the nominal stability of 
the IMC system automatically guarantees the stability of the feedback system 
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in Figure 9.2 with K determined from (9.11). However, the proposed design 
makes a controller approximation K and thus gives the nominal single-loop 
system shown in Figure 9.10(a), where K{s) = iC(s)(l + Ak{s)). The system 
in Figure 9.10(a) can be redrawn as Figure 9.10(b), where 



Q = 



GK 

1 + GK' 



Using (9.11), Q{s) can be written as Q = —GC and is stable. With the standard 
assumption that K has the same number of unstable poles as K, the nominal 
single-loop feedback system is stable (Green and Limebeer, 1995) if and only if 

|(?0'a;)C'0'a;)Z\/f(ia;)| < 1, Vw. (9.25) 

It follows from (9.1)-(9.3) that GC — G+/. But \G^{juj)\ = 1, Vcj and 
|G+/Z\x| = I/Ak], (9.25) then becomes 



\f{ju)AK{ju})\ < 1, Vw. 



(9.26) 
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Note from (9.4) that \f{joj) \ decays quickly for uj > Ucb = ^ and (9.26) is 
likely to hold for high frequencies. Thus, assume that (9.26) is true for u > Uch- 
One now needs to check (9.26) only for the working frequency range [0, oocb], 
and because \f{juj)\ < 1 for all uj, the nominal closed loop is thus stable if 

= ^^€[0, a;,,]. (9.27) 

In the proposed algorithm, the approximation accuracy has to meet (9.16), 
where e is usually specified as 3%. The resulting controller K then satisfies 
(9.27) with a large margin and nominal stability of the designed single-loop 
system is thus expected. 

Consider now model uncertainty. Let the actual plant be G{s) = G{s){l -f 
Z\g(s))- In the IMC design (Morari and Zafiriou, 1989) to achieve robust sta- 
bility, the filter parameter r is chosen big enough to meet the condition: 

\G{ju})C{juj)AG{juj)\ < 1, or \f{juj)AG{juj)\ < 1, Vcj. (9.28) 



The single-loop system with process uncertainty is shown in Figure 9.11(a), 
where \Ak\ < Sk{(^) and \Ag\ < Sg{(j^), and it can be redrawn into the 
standard form in Figure 9.11(b), where ^(s) is the normalized uncertainty 
A = dia.g{AK, Ag} with \Ak\ < 1 and \Ag\ < 1. The transfer function ma- 
trix between 2 : and x has no uncertainty and is given by 




1 

0 

1 




[0 <5gJ 




Sk 0 




_0 6g_ 





-GK -K 
G -GK 



(1 + GK) 



-GC -C 
G(1 - GC) -GC 



-1 



whose stability is guaranteed by that of G and C. It follows from the stability 
robustness theorem (Doyle et al, 1982) that the uncertain feedback system 
remains stable for all A = diagj^ic, Ag] if and only if 



IIQt < 1, (9-29) 

where \\Q\\^ = sup jj.{Q{juj)) and /i(-) is the structured singular value with 

(jj 

respect to A. In our case, the structured singular value fi{Q{juj)) can be cal- 
culated by 

= n{DQD-^) = Ma{DQD~^), 
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Fig. 9.11. Block diagram of system with process uncertainty 



where D = dmg{di,d 2 }, di, 0^2 > 0 and a(-) represents the largest singular 
value. 

After some calculations, we obtain 




and the robust stability condition (9.29) becomes 
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S%\GCf + 5l\GC\^ + 28k5g\{1 - GC)GC\ + 

+^J{5l\GC\^ + <5^|GC|2 + 25k8g\{ 1 ~ GC)GC\Y - A8\5l\GC\^ 

< 2, Vw. (9.31) 

Since A8]i8%\GC\^ > 0, Vw, and |1 - GC| < 1 + IGCI < 2, (9.31) is satisfied if 
8]i\GC\^+8l\GC\^+^8K8G\GC\<l, Vw, (9.32) 

i.e., 

(w)<5g(w) |/(jw)| < 1, Vw. 

As |/(jw)| decays quickly for w > ujcb = , then (9.32) is likely to hold 

for high frequencies. Thus, assume that (9.32) is true for uo > ojcb- One now 
needs to check (9.32) only for the working frequency range [0, ojcb], and because 
|/(i^)| < 1 foi* all uj, the closed loop is robustly stable if 

<5a-(‘^)+<^g(‘^)+4<^kM<^g(w) <1, w e [0, Ucb]- 

In the proposed method, \Ak\ is made small, i.e., Sk{oo) < 3%. Let Sk = 
3%, then the robust stability of the closed loop is guaranteed by 

^g{^) < 94.13, uj G [0, oucb]- (9.33) 

Note that for Sk = 0, i.e., no controller uncertainty, (9.30) reduces to 
li{Q{j(jj)) = \GCSg\- Then the robust stability condition (9.29) is simplified 
to sup|G(75g| < 1? which is equivalent to the robust stability condition (9.28) 

UJ 

of the IMG system. 

Example 9.2.3 (cont’d). Reconsider 

^ 

(5^ + 5 + 1 )( 5 ^ + 0.6s + 1) ’ 

with nominal a — ao = 1. When r = 0.6687, the proposed method yields a 
5th-order controller in (9.24) and the nominal performance is shown in Figure 
9.7. It can be seen that the system is indeed nominally stable. To demonstrate 
robustness, introduce a 50% perturbation from the nominal gain of a, giving 
a == 1.5. Figure 9.12 shows the resulting performances, and indicates that the 
single-loop high-order controller K derived using the proposed method exhibits 
a similar robust performance to the IMG loop. 

When r = 1.1687, the proposed method yields a PID controller as in (9.21) 
and the nominal performance is shown in Figure 9.8. We also introduce a 50% 
perturbation in gain, giving a = 1.5. Figure 9.13 shows the resulting perfor- 
mance, which is still stable, and more robust than that shown in Figure 9.12 
for r = 0.6687. 
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9.5 Unstable Processes 



It is well known that the IMG scheme is internally unstable if the process G{s) is 
unstable (Morari and Zafiriou, 1989) and is thus not implement able. However, 
Morari and Zafiriou (1989) suggest that one can still design the controller using 
the IMG method, and then implement the controller in an equivalent feedback 
structure as follows. In the nominal case (the uncertain case will be discussed 
below) of G{s) = G{s), the equivalent single-loop feedback system of Figure 
9.2 is derived from the IMG system of Figure 9.1 with 

K = C{l-GC)-\ (9.34) 



The system is internally stable if 

C and {1—GC)G are both analytic in the RHP. (9.35) 

Generally, the feedback controller K in (9.34) should include an integrator to 
eliminate the steady-state error, and maintain stability. Thus we require 

RT(after all possible pole-zero cancellations) 

has no pole in the closed RHP except 5 = 0. (9.36) 

Let us consider a class of unstable processes with a single RHP pole only: 

G(s) = 3^G_(s)e-^*, (9.37) 

where G-{s) is rational, stable and of minimum phase. The optimal H 2 IMG 
controller for step inputs is 

C = {l-Ts)GZ^f, (9.38) 



where / is a user-specified low-pass filter and chosen as 



f{s,T) 



as + 1 

{ts + !)”*+! ’ 



a = T(r/T+l)’"+ie^/^-r, 



(9.39) 



where m is an integer large enough to guarantee that the IMG controller C is 
proper. One can easily verify that (9.35) holds for all r > 0. Thus, r > 0 is the 
only tuning parameter to be selected by the user to meet (9.36) and achieve 
the appropriate trade-off between performance and robustness, and to keep the 
manipulated variable within bounds. We now address them separately. 

For G as in (9.37) and C as in (9.38), K in (9.34) becomes 



K{s,t) 



(1 - Ts){as + 1) 

G-{{ts + l)"»+i - (as + l)e~^*) 



(9.40) 
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It can be verified that 5 = ^ is both a zero and pole of K{s). It should be 
cancelled to form the final K{s) for actual implementation. 5 = 0 is another 
pole of K{s), which is necessary to eliminate the steady-state error. Equation 
(9.36) requires that no roots of the denominator of K{s,r) lie in the closed 
RHP, expect s = and s = 0. Since G_ is of minimum phase, from (9.3) we 
only need to investigate the root locations of 



S{s,t,L) = -{as-fl)e 


(9.41) 


Normalize L, r, a, s a>s L = L/T^ f = r/T, a = a/T and s 


= sT, Equation 


(9.41) then becomes 




5{s,f,L) = (f5 + l)"^+^-(a 5 + l)e-^^ 


(9.42) 


Equation (9.42) is a quasi-polynomial and can be written into a standard 


form. 




Q{s,l) = A(s) + B{s)e~^\ 


(9.43) 


where A(s) and B{s) are polynomials in s. Walton and Marshall (1987) pro- 
posed a method to study the movement of the roots of (9.43) with respect to 
a given parameter and this can be employed to determine the minimum f at 
which roots of (9.43) lie on the imaginary axis. This fmin should meet 


cos(o;oL) Re { " • - . 1 


(9.44) 


sin(o;oL)=Im{ .,.,1 

ja;oa + 1 


(9.45) 


where 




Wo = {min(wo)|(w^f^i„ + l)™+^-(w^a^ + l) = 0 , wq > 0 }. 


(9.46) 


Thus, for a given L, f should be chosen to satisfy 




^ '^mim 


(9.47) 



to ensure stability. For a given m, fmin depends on L. When m = 1,2,3, the 
typical relationship between fmin and L is shown in Figure 9.14. It is interesting 
to note that when fmin tends to infinity, L tends to a constant, Lmax^ which 
indicates that there is a limitation on tuning r for stabilizability and that the 
process is stabilizable only if L < Lmax- Lmax is determined by m only and 
can be obtained as 
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Fig. 9.14. Typical relationship between Tmin and L 



{max(L) I = 4/ + 1 

{max(Z) 1 < (7r)™},m = 41 + 2 

{max(Z) I < (f = 4/ + 3 

^ {max(L) I < (2n )"^}, m = 4/ + 4 



(9.48) 



where I = 0, 1, 2 • • • . 

For system performance, with controller K{s) in (9.40), the closed-loop 
transfer function is 



T]{s) 



G{s)K(s) 
l + G{s)K{s) 



G+{s)fis) 



as + 1 
{ts + 



e 



-Ls 



(9.49) 



The maximum of the magnitude of r] is related directly to L and r as 



M\oo 



(^(1 -(m + l)(|)2) + !)-+! • 



(9.50) 



A typical relation between ||7y||oo and f is shown in Figure 9.15. The large 
amplitude of ||ry||oo usually produces a peak overshoot in the step response in 
the time domain perspective (Kuo, 1991). To eliminate the overshoot, a prefilter 
F = is added with a given in (9.39), as shown in Figure 9.16. 

For system robustness, let the actual process be G{s) = G(s)(l + zAg( 5)) 
with \Ag\ < Sg(oo). In implementation, the presence of dead time in the de- 
nominator of K{s) increases the complexity of the controller. Moreover, due 
to the fact that the denominator of K{s) is not in polynomial form, it is not 
possible to cancel s = ^ in K{s) explicitly. Thus, model reduction is applied 
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Fig. 9.15. Relation between \\rj\\oo and r 




to obtain the best approximation K to RT, where K{s) = K(5)(l + Z\i<'( 5 )) and 
< Sk{oj)- In our context, Sk{<^) < ERR < e, where e is the threshold for 
model reduction error and is specified prior to the design and usually taken as 
5%. With the standard assumption that K has the same number of unstable 
poles as K, it follows from the stability robustness theorem (Doyle et al, 1982) 
and some algebra that the uncertain feedback system remains stable for all 
A = Amg{AK,AG} if 

< 1, Vw. (9.51) 

It is noted from (9.49) that \r]{juj)\ has a peak value at a low frequency Up and 
decays quickly for higher frequencies. Then (9.51) is likely to hold if 



<^l:(t^p)ll»7ll^+<5GH)ll»7llL+4<5i<:(‘^p)^G(t^p)||»?||oo < 1- 



(9.52) 
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An upper bound on ||r7||oo can be obtained from (9.52): 

2(SlM+S^aM) 

Combining (9.50) and (9.53) yields 



. (9.53) 






. 2^S-j,(u;)+S‘^(u;)+4S‘j,(cj)S‘^(u;) - 4 SkHSg(uj) 

< ^ 

which gives a range of r to achieve robust stability. 

To consider the performance limitation imposed by input constraints, 
we still use frequency-by-frequency analysis. Assume that at each frequency 
1^0^) I < ^ Sind the reference signal satisfies \R{juj)\ < R. The manipulated 
variable is 



1 -Ts 
(ts + 1)”»+1 



Gz\s)R{s). 



It is required that 

1 - Tjuj ^ 
{rjuj + 1)’”+! 



Gz\MR(juj) < U. 



Consider the worst case \R{juj)\ = R, which requires 
(rjw + l)™+i - 1’ 

To derive an inequality on r imposed by the input constraint, let uo = ujoh, where 
(Job is the open-loop bandwidth, and notice that ^ G-{j(Job) ~ 

require 

^ <J_£ (9 57) 

(rju;o6 + l)™+i -y/2R’ ^ ’ 




- 1 / UJob- 
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Therefore, for open-loop unstable process controller design the tuning pa- 
rameter r in the filter (9.39) should be, in general, chosen to meet (9.47), 
(9.54) and (9.58) simultaneously and this will determine a suitable range, 
^ irminy'^max) ' 

Once the ideal single-loop controller K{s) has been found, model reduction 
is again applied to obtain its PID or high-order controller approximation. The 
procedure is similar to the stable case discussed earlier and we only highlight 
possible differences and present simulation examples as follows. 



9.5.1 PID Controller 



Consider a PID controller in the form (9.14). Following the same steps as in 
Section 9.2, the optimal PID controller Kpjd can be obtained. If the user- 
specified fitting error threshold in (9.16) holds true, the design is complete. 
On the other hand, one can increase r by the de-tuning rule in (9.17). The 
iteration continues until the accuracy bound is fulfilled or > Tmax^ If 
(9.16) cannot be fulfilled when > Tmaxy a more complex controller than 
a PID is necessary. We now present some simulation examples to demonstrate 
our PID tuning algorithm and the performance is compared with the results of 
Huang and Chen (1997), Majhi and Atherton (2000), and Park et al. (1998). 
As in Section 9.2, the ideal PID controller in (9.14) is replaced by version (9.19) 
for implementation. In simulation examples of this subsection, we consider the 
nominal case and (9.54) is not used. Normally, (9.58) gives a smaller lower 
bound on r and thus only (9.47) is utilized to derive Tmin, and we set 
in Examples 9.5. 1-9. 5. 3. 



Example 9.5.1. Consider an unstable process (Huang and Chen, 1997) 

4g-2s 

From (9.47) one obtains = 1.7. This results in 

0-0626 0.56335 

KpiD = 0.6407 H h 



0.5633 « , 1 • 
N ^ 



(9.59) 



This controller has the approximation error ERR = 1.80%, which can meet the 
accuracy threshold. The PI-PD controller of Majhi and Atherton (2000) are 
fcp(l-h^) - 0.131(1 + ^) and Kf{TdS + l) = 0.5(5 + !). The PID-P controller 
of Park et al. (1998) has Kp{l + ^ + Tds) = 0.068(1 + + 4.2965) and 

Kf = 0.350. The closed-loop responses are shown in Figure 9.17. It can be 
seen that the proposed method shows much better performance than the other 
designs. 
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time 



Fig. 9.17. Step response for Example 9.5.1 

( proposed, Majhi and Atherton, — • — • — Park et al.) 



Example 9.5.2. Consider an unstable process (Park et al.., 1998) 



O-0.5S 






(l-2s)(0.5s + l)‘ 

The proposed design gives = 0.6 and 

0 . 0^0 1.5651s 

KpiD — 3.1308H h 



1.5651 

N 



S + l’ 



(9.60) 



with ERR = 0.47%. The PI-PD controller of Majhi and Atherton (2000) are 
0.937(1+ ^ 33 Q^ ) and 2.328(0.53s+l). The PID-P controller of Park et al. (1998) 
are 0.561(1 + + 1.478s) and Kf = 1.687. The closed-loop responses are 

shown in Figure 9.18. 



Example 9.5.3. Consider an unstable process (Huang and Lin, 1995) 

p-0.5s 

Q _ 

(l-5s)(2s + l)(0.5s + l)' 



It follows that — 1 and 



r. 0-5106 7.2571s 

KpiD = 4.3794-1 h 



7 .2571 

N 



S+1’ 



(9.61) 



with ERR = 26.07%, which cannot meet the accuracy threshold, and the 
closed-loop response is very poor. Then r is adjusted to L = 1.5 

according to the proposed tuning rule (9.17). The new r results in 
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tins 



Fig. 9.18. Step response for Example 9.5.2 

( proposed, Majhi and Atherton, — • — • — Park et al.) 



J^PID — 2.9886 + 



0.2335 4.66685 



■ + 



4.6668 

N 



5 + 1’ 



(9.62) 



which has ERR — 2.06 and meets the specified approximation accuracy 
ERR < 5%. The controller in Huang and Chen (1997) is 

0.1395 1.47245 



= 6.1859(1 + - 



- + 



1.4724 

N 



5 + 1 



)• 



(9.63) 



The closed-loop responses are shown in Figure 9.19. One observes that our 
design yields great improvement over Huang’s method. 



It can be seen from the simulation study that the proposed method always 
yields a PID controller with much better performance than the other methods, 
regardless of what r is chosen. Our experience indicates that for FOPDT and 
SOPDT processes and a slow closed-loop response requirement, the proposed 
method can always achieve ERR < 5%, and thus the closed-loop performance 
can be well predicted from the corresponding IMC design. It is, however, noticed 
that for high-order processes with fast responses, none of the above methods 
is able to generate PID systems with good performance. This implies that 
controllers in PID form are insufficient to obtain the desired performance. In 
this case, a higher-order controller has to be considered for better fitting and 
performance. 
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Fig. 9.19. Step response for Example 9.5.3 

( proposed PID (r = 1), proposed high order (r = 1), Huang and 

Chen, — . — . — proposed PID (r = 1.5)) 



9.5.2 High-order Controller 

The idea here is the same as in Section 9.3, that is to find the lowest order of 
controller in the form of (9.22) that can match the ideal controller K{s) as well 
as possible in the frequency range of interest and can meet a specified approx- 
imation accuracy. However, the rules for determining the IMC filter change for 
the present unstable processes. We thus need to summarize the tuning proce- 
dure again. 

Tuning Procedure for Unstable Processes 

Step 1. Find the smallest Tmin from (9.47) and (9.58), and let = Tmin- Find 
the largest Tmax from (9.54) if the plant uncertainty So is given. 

Step 2. Determine the PID controller from (9.15) and evaluate the correspond- 
ing approximation error ERR in (9.16). If ERR achieves the specified 
approximation accuracy e (usually 5%), end the design. 

Step 3. Otherwise, we have two ways to solve this problem: if a PID controller 
is desired, update r by (9.17), and go to Step 2 when r < Tmax’, else, 
go to Step 4. 

Step 4. Adopt the high-order controller in (9.22), start with a controller of 
order 2 up to the smallest integer n for which ERR < e. 

Example 9.5.3 (cont’d). Reconsider 
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p-0.5s 

Q _ 

(1-55)(25 + 1)(0.55 + 1)’ 

for which = 1 and a PID has been obtained with ERR = 26.07%. For a 
high-order controller, our procedure ends with 



29.8188s^ + 75.8869 s 2 -f 39.45565 + 4.3412 
53 -h 3.2042^2 -h 8.5984s 



(9.64) 



with fitting error ERR less than e = 5%. The closed-loop step responses are 
shown in Figure 9.19. We can see that the new controller K restores the IMC 
performance, while the previous PID controller in (9.61) is not capable of that 
under such a tight performance specification. 



Example 9.5.4- Consider an unstable process 

p-1.2s 

Q _ 

(1 — s)(0.5s -h 1) * 

It follows that r® = 2.7, and 



KpiD = 1.0134-h 



0.0063 



(9.65) 



with ERR = 18.50%, which cannot meet the accuracy threshold, and the 
closed-loop response is very poor. One can de-tune the PID controller by in- 
creasing r. However, this results in a sluggish response. For a high-order con- 
troller, our procedure ends with 



5.2221s^ -b 41.6265s^ + 128.3411s2 -h 131.1146s -h 0.7798 
s^ + 14.0061s3 + 9.6026s2 -f 123.0987s 



(9.66) 



with the fitting error ERR less than e = 5%. The closed-loop step responses 
are shown in Figure 9.20. We can see that the high-order controller makes a 
significant improvement over the PID controller. To our knowledge, the PID 
controller design methods in the literature are not applicable to this example 
(Huang and Chen, 1997; Majhi and Atherton, 2000; Park et al, 1998). 
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In this chapter, we extend the SISO design methodology of Chapter 9 to the 
MIMO case. The development of MIMO internal model control (IMC) is not 
straightforward. In principle, if a multivariable delay model G(s) can be fac- 
torized as G(s) = G-i-(s)G-(s) such that G+(5) is diagonal and contains all 
the time delays and non-minimum-phase zeros of G(s), then the IMC controller 
can be designed as C(s) = GZ^(s)F(s), with a possible filter F(s), and the con- 
ventional feedback controller is related to the IMC controller, as in the scalar 
case, via K(s) = C{s)[I — G(5)C(s)]“^. For a scalar transfer function, it is 
quite easy to obtain G^{s). However, this becomes much more difficult for a 
transfer matrix with multi-delays. The factorization is affected not only by the 
time delays in individual elements but also by their distributions within the 
transfer function matrix, and a non-minimum-phase zero is not related to that 
of elements of the transfer matrix at all. 

Note also that for the SISO case the output behaviour is completely de- 
termined by the delay-free design shifted by the plant time delay, whereas one 
can hardly tell the MIMO output performance from the delay-free design be- 
cause the delays in the process could mix up the outputs of the delay-free part 
to generate a messy actual output response. Decoupling between the loops, in 
addition to serving its own purpose, can rectify such a problem. Therefore, 
in this chapter, decoupling will be set as a design objective. The reasons are 
that (i) decoupling is usually required (Kong, 1995) in practice, at least in the 
process control industry, for ease of process operations, (ii) According to our 
experience, poor decoupling in closed loop could, in many cases, lead to poor 
diagonal loop performance, in other words, good decoupling is helpful for good 
loop performance, (iii) It should be noted that even if the decoupling require- 
ment is relaxed to limited coupling, it will still lead to near decoupling if the 
number of inputs/outputs is large. Roughly, if the number is 10, total cou- 
plings from all other loops are limited to 30%, then each off-diagonal element 
will have a relative gain less than 3%, so the system is almost decoupled, (iv) 
The decoupling also simplifies the design procedure. In fact, it enables elemen- 
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twise controller design (see Section 10.1). Otherwise, it is impossible and one 
has to design the controller matrix as a whole if the decoupling is removed or 
relaxed. It should be emphasized that we are aware that there are cases where 
decoupling should not be used; instead, couplings are deliberately employed to 
boost performance. But this is not the topic of the present chapter. We address 
decoupling the IMG in Section 10.1 and decoupling the conventional feedback 
scheme in Section 10.2. 




Fig. 10.1. Internal model control 



10.1 IMC Scheme 



The systems considered here are square, stable, nonsingular MIMO linear sys- 
tems. In the process industry, most processes are open-loop stable. A process 
usually has unequal numbers of inputs and outputs, but normally a square 
subsystem will be selected from it for control purposes. A singular process es- 
sentially cannot provide independent control of each output and should not be 
used. Thus, in this section, we consider stable and nonsingular processes only. 

The IMC control system is depicted in Figure 10.1, where G and G represent 
the transfer function matrices of the plant and its model, respectively, and C 
the controller. G is assumed to be identical with G except in our discussion on 
robust stability: 






G(s)=G(s) = 



Plm(^) 



_^ml (^) 9mm(^) 



where 



( 10 . 1 ) 



9ij{^) — 9ijo{^)^ 



, Lij s 
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and gijo{s) are strictly proper, stable, and scalar rational functions and Lij are 
non-negative constants. It is also assumed that a proper input-output pairing 
has been made for G{s) such that none of the m principal minors of G(s) (the 
ith principle minor is the determinant of a (m — 1) x (m — 1) matrix obtained 
by deleting the ith row and ith column of G{s)) is zero. Our task in this section 
is to characterize all the realizable controllers C and the resultant closed-loop 
transfer functions such that the IMC system is internally stable and decoupled. 



10.1.1 Decoupling 



The closed-loop transfer matrix H between y and r can be derived from Fig- 
ure 10.1 as 

H = GC[I + {G-G)C\-^, 

which becomes 

H = GC, if G = G. 



Thus, the closed-loop is decoupled, i.e., H is diagonal and nonsingular, if and 
only if GC is decoupled and the IMC system is internally stable if and only 
if C is stable. Therefore, the problem becomes to characterize all stable and 
realizable controllers C and the resulting H such that GC — H \s decoupled. 

The first question to ask is whether or not a solution exists. For a stable 
and nonsingular G, one may write 



G(s) = 



N{s) 
d{s) ’ 



where d{s) is a least common denominator polynomial of G(5). Now choose 
C{s) as 



_ adjiV(s) 



where adj N{s) is the adjoint matrix of N{s) and (t{s) is a stable polynomial 
with degree high enough to make the rational part of each Cij proper. Then, 
this C{s) is stable and realizable and decouples G{s) since 



G(5)C(s) = 



\N{s)\ ^ 
d(s)a{s) 



where | • | stands for the determinant of a matrix and Im is the m x m iden- 
tity matrix. Thus C(s) is a solution. Nonsingularity of G(s) is obviously also 
necessary in order for GC to be decoupled. 
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Theorem 10.1.1. For a stable, square and multi-delay process G{s), the de- 
coupling problem with stability via the IMC is solvable if and only if G{s) is 
nonsingular. 

Our task is now to find a C{s) such that G{s)C{s) is decoupled, i.e., 

[ci C2 ••• Cm] = diag{?ii, i (10.2) 

For each column of GC, we have 



GC = 



91 

92 

9 m 



91 

92 



T 

Cj = [o ••• 0 ••• o] , i = l,2,...,m, 



9m 



(10.3) 



which is equivalent to 

[..1 



9i—l 

9i-\-l 



Ci — 0, i — 1,2,..., 771 , 



|_ 9m 

and 



(10.4) 



9 iCi = qu 7^0, 7 = 1, 2, • • • , m. (10.5) 

For any i, we can solve (10.4) to obtain ci^i, • • • , • • • , Cm,i, in terms 

of Cii as 
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Cli 




i’li 






i/’i-i,* 








^mi 




'^mi 



where m = {1, 2, • • • , m} and 



Vi G m, 







p 






-1 


p -| 


V’li 




911 • 


• 914-1 914+1 ' 


9lm 




9li 






9i-l,l • 


‘ 9i—i4—i 9i—i4+i * 


* 9i—l,m 




9i—14 






9i-\-l,l • ' 


■ • 9i+i4-i 9i+i4+i ’ ' 


' ' 9i+l,m 




9i+i4 


Xpmi 




9ml 


9m4—l 9m4+l * ' 


9mm 




9mi 



The ith diagonal element of GC is gucu^ where 



9ii — 9ii ^ ^ 9ik'4^ki 



k=l 

k^i 



( 10 . 6 ) 



(10.7) 



(10.8) 



One notes that for a given i, the resulting diagonal element of GC is inde- 
pendent of the controller off-diagonal elements but contains only the controller 
diagonal element cu. 

To further simplify the above result, let G'^^ be the cofactor corresponding 
to 9 ij in G. It follows from linear algebra (Noble, 1969) that the inverse of G 
can be written as G~^ — where adjG = [G-^*]. This also means 



9ii ' " 9lm 



9ml ’ ' * 9mm 



Gfii ... 



Grim ... Qn 



= \G\Irr 



(10.9) 



Equation (10.9) can be equivalently put into the following two relations: 
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Oil • • • 

• • • 9i-i,i-i 
9i+iA • * • 9i-\-i,i-i 

9ml ’ * ' 9m,i—l 



Pl,i +1 * * * 9 lra 

pi— 1,2+1 * ’ * 9 i—l,m 
Pi+l,i+l * ‘ ' Pi+l,m 

pm, 2+1 * * ' 9 mm 



Qil 




9li 


Qi,i-1 




9i—l,i 


Qi,i+1 




Pi+1,2 


Qifn 




9mi 



V i € m, 



and 



m 

^PifcG*^ = |G|, Viem. 

fc=i 



Substituting (10.10) to (10.7) yields 



p -| 




p 






-1 




V’K 




Pll • 


• Pl,i-1 Pl,i+1 • 


Plm 




Pli 


V’i-i.i 




Pi-1,1 ' 


• Pi-l,i-l pi-1, i+1 • 


pi— l,m 




9i—i4 


lpi+l,i 




Pi+1,1 • ' 


• Pi+l,i-l Pi+l,i+l * ■ 


’ * Pi+l,m 




Pi+l,i 


Ipmi 




Pml * ' 


Pm,i— 1 pm, i+1 * ' 


9mm 




9mi 



Gil 



1 



Qi,i-i 

QiA+l 



[ G'™ J 

or 

Gb' 

By (10.11), (10.6) and (10.8) become respectively 



(10.10) 



( 10 . 11 ) 
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and 

Qik 1 1^1 

9ii = y^^QikG — Vi G m. (10.13) 

k=l k=l 

k^i 

Thus, the decoupled open-loop transfer function matrix is given by 

G(7 = diag{ 5 iiCjj} = diag * = 1,2, • • • ,m| . (10.14) 

Before proceeding further, it is interesting to note that ^ is the (i, i)th element 
of G~^. And it follows from Bristol (1966) that the (i,i)th element of the 
relative gain array for G is given by Xu = Hence, gu is linked to gu by 

9ii — \i 9ii' 

To demonstrate how to find gu and take the following as an example: 



G(.) = 

Simple calculations give 






-1 



s-0.5 (g-0.5)^ o., 

(F+W 2{s + 2f , 



(10.15) 



1(71 — 


2(s-0.5)(s + 2)e- 


-9s + (5 _ o. 5 ) 2 e-ios 


|U| — 


2 (s 


+ 2)4 


G“ = 


(s - 0.5)2e-«* 


p— 6 s 


2 (s + 2)3 ’ 


s + 2 ’ 


II 


p-2s 

, = . 


(s - 0.5)e-3* 


5 + 2’ 


(s + 2)2 • 



It follows from (10.13) that the decoupled loops have their equivalent processes 



as 



911 



2(5 + 2)e“" + (5 - 0.5)e 
(5-0.5)(5-f2) 



-2s 



922 



2(5 - 0.5)(5 + 2)e-^" + (5 - 0.5)2e-«" 
2(5 + 2)3 



respectively. By (10.11), ip 2 i and ^12 are found as 



'^21 = - 



2(5 + 2) 5^ 

n r ^ 5 



^12 = e 



At first glance, each diagonal controller cu may be designed for gu according 
to (10.14) and the off-diagonal controllers can then be determined from (10.12). 




280 10. Multivariable Systems 



Recall that for SISO IMC design, a scalar process g{s) is first factored into 
g(^s) = g~^{s)g~{s), where g^(s) contains all the time delay and non-minimum- 
phase zeros. The controller c(s) is then determined from g{s)c{s) = g^{s)f{s), 
where f{s) is the IMC filter. This technique could seemingly be applied to the 
decoupled equivalent processes gu to design cu directly, but it is actually not. 
The reasons are that in general gu are not in the usual format of a rational 
function plus time delay, and more essentially, a realizable cu derived from 
(10.14) based on gu only may result in unrealizable or unstable off-diagonal 
controllers Cj^, j ^ z. In other words, realizable j 7^ i, may necessarily 
impose additional time delay and non-minimum-phase zeros to cu> 



10.1.2 Analysis 



In what follows, we develop the characterizations of time delays and non- 
minimum-phase zeros for the decoupling controller and the resulting decoupled 
loops. For the nonsingular delay process G{s) in (10.1), a general expression 
for gu in (10.13) will be 



<j){s) = 



Etonk(s)e-->‘^ 

+T>iLidi{s)e~0‘^' 



(10.16) 



where rik{s) and di{s) are all nonzero scalar polynomials of s, ao < ai < • • • < 
aM and 0<^i < P 2 < ' " < Pn • Define the time delay for nonzero (j){s) in 
(10.16) as 



7(0(s)) ao. 

It is easy to verify 'y{(pi(t> 2 ) = 7(^1) +7(</>2) and "y{(f)~^{s)) = —^{(l){s)) for any 
nonzero (/>i(s), 02 (^) and 0(s). If 7(0(s)) > 0, it measures the time required 
for 0(s) to have a nonzero output in response to a step input. If 7(0(s)) < 0 
then the system output will depend on the future values of the input. It is 
obvious that for any realizable and nonzero 0(s), 7(0(5)) cannot be negative. 
Therefore, a realizable C requires 



7(cji) > 0, ViGm, jGJi, (10.17) 

where = {j G m | / 0}. It follows from (10.12) that 

nij 

7 (cji) = = 7 (G*^) - 7(G") + 7(cii) , 

Thus, (10.17) is equivalent to 



Vi € m, j e Jj. 
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7(c«) > 7(G”)-7(G®^), Vi e m, j € J^, 



or 



7(cm) > 7(G“)-7i. Vi€m, (10.18) 

where 

7i = min7(G*'^). (10.19) 

i€Jt 

Equation (10.18) is a characterization of the controller diagonal elements in 
terms of their time delays, which indicates the minimum time delay that the 
iih diagonal controller elements must contain. Consequently, the resulting ith 
diagonal elements of H = GC, ha = gucu^ meet 

l{hii) = 7(5ii)+7(cn) > 7 (p«)+ 7(G'“)-7«, Vi e m, 
which, by 

7(5«)=7(P) =7(|G|)-7(G”), 
becomes 

7(/i«) > 7(|G'l)-7i, ViGm. (10.20) 

Equation (10.20) is a characterization of the decoupled ith loop transfer func- 
tion in terms of their time delays, which indicates the minimum time delay that 
the ith decoupled loop transfer function must contain. One concludes from the 
above development that for a stable and realizable IMC controller C which 
decouples G, its diagonal elements are characterized by (10.18) for time de- 
lays and they will uniquely determine the off-diagonal elements using (10.12). 
Equation (10.20) characterizes the time delays of the resultant loops. 

For illustration, consider again the example in (10.15). It follows from the 
definition that the time delays for respective functions are 7(|G|) = 9, 7(G^^) = 
8, 7(G^^) = 3, 7(G^^) = 6 and 7(G^^) = 2. The values for 71 and 72 can be 
calculated from (10.19) as 

71 = min{7(C?“),7(G^^)} =min{8,3} = 3, 

72 = min {7(<?^^),7(G^^)} = min{6,2} = 2. 



It follows from (10.18) that cn and C22 are characterized for their time delays 
by 
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7(cn) > 7{G“) - 7 i = 8 - 3 = 5, 

7(c22) > 7(G^^) - 72 = 2 - 2 = 0. 

Also, hii and /i22 must meet conditions 

> 7(|G|) - 7i = 9 - 3 = 6, 

7(/i22)>7(|G|)-72=9-2 = 7. 

Consider now the performance limitation due to the non-minimum-phase 
zeros. Denote by the closed right half of the complex plane (RHP). For 
a nonzero transfer function <t>{s)^ let Zj be the set of all the RHP zeros of 
0(s), i.e., Zj = G I (t){z) = 0}. Let r]^{(j)) be an integer u such that 
lims_).;2 (j){s)l{s—zY exists and is nonzero. Thus, ^(5) has ri^{(j)) zeros dX s — z if 
r}^{(f)) > 0, or —ri^{(j)) poles if rjzi^) < 0? or neither poles nor zeros if r/^(0) = 0. 

It is easy to verify that + Vzih) and Vzi^~^) = ~Vzi<P) 

for any nonzero transfer function (t>i{s), <^2(5) and (t){s). Obviously, a nonzero 
transfer function (j){s) is stable if and only if 77^(1^) > 0, Vz G C+. 

A stable C thus requires 

Vzi^ji) > Vi G m, j G Ji, z G C"^. (10.21) 

It follows from (10.12) that 

Vzicji) = Vz (§77^«) = VziG'^)-VziG'')+Vzicii), Vi G m, j € Ji, z € C+. 
Thus (10.21) is equivalent to 

Vzicii) >Vz{G'')-VziG'^)y Vi G m, j G Ji, z G C+, 



or 

Vzicii) >VziG^')-Vi{z), ViGm, zGC+, (10.22) 

where 

T?i(z) = minTj^(G*^). (10.23) 

j€Ji 

Since G{s) is stable, so are . One sees that for Vi G m and Vz G C+, 
T)i{z) > 0. We have, for Vi G m and Vz G C'^ , 

vAGn-TH{z)<rjAG% 



and 
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T,,{Gn-rHiz) = r7,(G")-minT,,(G*^) > = 0. 

jeJi 

Thus, T]^{G”) — r]i{z) is bounded by 

0 < VziG"')-Vi{z) < Vi € m, ^ G C+. (10.24) 



Equation (10.24) also implies that cu need not have any non-minimum- 
phase zeros except at z G Z'^a. Therefore, by (10.22), cu is characterized for 
its non-minimum-phase zeros by 



> T]^(G^^)-r]i(z), z€ 7+^^, 



(10.25) 



with the right side bounded by (10.24). 

Consequently, the resulting ith diagonal elements of H = GC, ha = guCu, 
satisfy 

Vzihii) = VziQiiCii) = Vzidii) + VziGi) > Vziau) + Vz(G'') ~ Vii^) 

V i € m, € C"*" , 



which, by 

rizi9ii) = Vz (P)=77,(|G|)-r,,(G*^ 
becomes 



Vzihii) > Vz{\G\)-miz), Viexa,zec+. (10.26) 

It is readily seen that for V i £ m, ^ € C" , 

Vzi\G\)-Vi{z) < Vzi\G\), 



and 



Vzi\G\) -Vi{z) = Vz 



|G| 



{s - z)^‘G) 






= ’>• E9«773 



GiJ 



(s - ^)’)d^) 

7 = 1 ^ 



> 0 . 



Thus, T 7 ^(|G|) - rii{z) is bounded by 

0 < Vzi\G\)-Vi{z) < Vzi\G\), Vi 6 m, 2 : € C+. 



(10.27) 
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Equation (10.27) also indicates that the ith closed-loop transfer function 
ha need not have any non-minimum-phase zeros except at z G Zj^|. Therefore, 
their characterizations on non-minimum-phase zeros are given by 

Vzif^ii) >Vz(.\G\)-m{z), Viem, zeZj^|, (10.28) 

with the right side bounded by (10.27). 

Consider the previous example again to demonstrate the method. It can be 
found that Zju = {0.5}, ZJ 22 = 0, Zj{j| = (0.5), r]zi\(^\)\z=o .5 - 1 and 

’7j(G'^^)U=0.5 = 2, 'nzi^^^)\z=o.5 = 1, 

^z(G^^)U=0.5 = 0, Vzi^^^)\z=0.b = 0. 

By (10.23), one sees 

m{z)\z=o.5 = min{T7^(G“)|^=o.5, ’nz{G^^)\z=o.^} = min{2, 1} = 1, 
m{z)\z=o.b = min{T7^(G^^)|z=o.5, ‘nz{G^^)\z=o.5} = min{0,0} = 0. 

Thus, cii should then satisfy 

^;z(cil)|z=0.5 > Vzi^^^)\z=0.5—Vl{^)\z=0.5 = 2 — 1 = 1. 

As Z ^22 = 0, there will be no constraint on C 22 at its non-minimum-phase 
zeros. By (10.28), the resultant loops satisfy 

'nz(^ll)\z=0.5 > Vzi\^\)\z=0.5 — 'fll{^)\z=0.5 = 1 — 1 = 0, 

Vz{h22)\z=0.5 > Vzi\G\)\z=0.b - V2{z)\z=0.b = 1-0 = 1, 

i.e., the second loop must contain a non-minimum-phase zero at 2 : = 0.5 of 
multiplicity one while the first loop need not contain any non-minimum-phase 
zero. 



Theorem 10.1.2. If the IMC system in Figure 10.1 is decoupled, stable and 
realizable, then (i) controller C ’s diagonal elements are characterized by (10.18) 
on their respective time delays and by (10.25) on their respective RHP zeros, 
and they uniquely determine the controller’s off-diagonal elements by (10.12); 
(ii) the diagonal elements of GC, ha = gucu, are characterized by (10.20) on 
their respective time delays and (10.28) on their respective RHP zeros. 



For the example in (10.15), choose the controller diagonal elements as 



Cll 



5-0.5 

( 

s -h p 



—5s 



C22 



s + p 
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where p > 0. It follows from the previous calculations that they satisfy the 
conditions of Theorem 10.1.2 with the lower bounds in (10.18) and (10.25) 
exactly met. The off-diagonal controllers are then obtained from (10.12) and 
the complete controller is 



^ J 

which is both realizable and stable, and the resulting GC is calculated as 



C = 



s — 0.5 ^-55 
s + p ^ 

— 2(g -f 2) 
s~T~p 



GC = 



~ 2s H- 4 + (g — 0.5)e 
(s + /?){s + 2) 

0 



-6s 



0 



(s - 0 5) + 4 + (s - 0-5)e~ 

2(s + p)(s + 2)^ 



-7s 



whose diagonal elements fall in our previous characterization on time delays 
and non-minimum-phase zeros, namely, the time delay for the decoupled loops 
is no less than 6 and 7, respectively, and loop two must contain a non-minimum- 
phase zero at 5 = 0.5 of multiplicity 1. 

However, if we choose the controller diagonal elements as 



Cll = C22 



1 

s + p’ 



which violates the conditions of Theorem 10.1.2, this gives rise to 



C21 



-2(g + 2) 5, 

(s -I- p)(s - 0.5) 



which is neither realizable nor stable. The resultant hn is given by 



2s -I- 4 -I- (s - 0.5)e * 

^11 Pll^ll / . \/ . r)\/ rk r\ ^ 5 

(5 + p)[s -h 2)(s - 0.5) 

which is unstable, too. Such cu should be discarded. 

A quite special phenomenon in such a decoupling control is that there might 
be unstable pole-zero cancellations in forming guCu. In contrast to the normal 
intuition, this will not cause instability. Notice from the previous example that 
pii has a pole at s = 0.5 and cn has at least one zero at the same location 
as r]^{cii)\z=Q.b > 1- Hence, an unstable pole-zero cancellation at z = 0.5 
occurs in forming puCn. However, the resulting closed-loop system is still stable 
because all the controller diagonal and off-diagonal elements are stable. In fact, 
as far as G and C are concerned, there is no unstable pole-zero cancellation 
since both G and C are stable. 
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10.1.3 Design 



In this subsection, the practical design of IMG is considered. We first briefly 
review the IMG design for the SISO case. Let g{s) be the transfer function 
model of a stable SISO process and c(s) the controller. The resulting closed- 
loop transfer function in the case of no process model mismatch is h(s), where 
h(s) = g(s)c(s). It is quite clear that if h(s) has been specified then c(s) 
is determined. However h(s) cannot be specified arbitrarily. In IMG design, 
the process model g(s) is first factored into g(s) = g~^(s)g~(s), where g'^(s) 
contains all the time delay and RHP zeros. Then h(s) is chosen as h(s) = 
g~^(s)f(s), where f(s) is the IMG filter, and consequently c(s) is given by 
c(s) = h(s)g~^(s). The factorizations which yield g~^(s) are not unique. Holt 
and Morari (1985a, 19855) suggested the following form to be advantageous: 



g^(s) = 




(10.29) 



where L is the time delay and ^ 2 , • • • , sire all the RHP zeros present in 

For multivariable decoupling IMG control, the closed-loop transfer function 
matrix H (s) in the case of no process model mismatch is 



If = diag {hiij = diaglgudi}, 



and thus the key point in design lies in specifying the m decoupled loop transfer 
function hu(s). Unlike the SISO case, hu(s) cannot be chosen based solely on 
gu(s) since this may cause an unrealizable and/or unstable controller. Instead, 
hii(s) should be chosen according to Theorem 10.1.2. It is also obvious that 
for best performance of the IMG system and simplicity of the controller it is 
undesirable to include any more time delays and non-minimum-phase zeros in 
hii(s) than necessary, that is, only the minimum time delay in (10.20) and min- 
imum multiplicity of unavoidable non-minimum-phase zeros in (10.28) should 
be included. This leads to 

/i,, = n (J^) ’ Viem, (10.30) 

where fi(s) is the ith loop IMG filter. ha(s) will then determine ca(s) as 

Cii(s) = hii(s)g^\s), i £ m, (10.31) 



which in turn yields off-diagonal elements Cji{s) uniquely by (10.12). 
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Remark 10.1.1, Good control performance of the loops is what we seek apart 
from the loop-decoupling requirement. However, we do not explicitly define a 
performance measure and design the controller via the minimization (or maxi- 
mization) of some measure. These are done in model predictive control, where 
the “size” of the error between the predicted output and a desired trajectory is 
minimized; and in LQG control, where a linear quadratic index is minimized to 
yield an optimal controller. These approaches have a different framework from 
ours. What we do here is to follow the IMG design approach with a require- 
ment for decoupling the control of multivariable multi-delay processes. Loop 
performance is simply observed with closed-loop step responses for each out- 
put, in terms of traditional performance specifications such as overshoot, rise 
time and settling time, in comparison with the existing schemes for similar pur- 
poses. A link between IMG design theory and quantitative error measurement 
is that the item with the non-minimum-phase factor g'^{s) in (10.29) used in 
the IMG closed-loop transfer function in (10.30) can actually minimize the H-2 
norm of the error signal in the presence of a step reference change (Morari and 
Zafiriou, 1989). 

Remark 10.1.2. One may note that there is the case where good decoupling 
and performance may not both be achievable and one is reached at the cost of 
the other. For example, decoupling should never be used in flight control, in- 
stead, couplings are deliberately employed to boost performance. This case is, 
however, not the topic of the present paper. Here we address applications where 
decoupling is required. Indeed, decoupling is usually required (Kong, 1995) in 
the process control industry, to simplify process operations. Poor decoupling 
in a closed-loop system could, in many cases, lead to poor diagonal loop per- 
formance. Thus, the design objective here is to decouple the loops first and 
then to achieve as good a performance as possible for each loop. Loop perfor- 
mance is considered to be good if best achievable performance is nearly reached 
among all decoupled and stable loops, subject to limitations imposed by delay, 
non-minimum-phase zeros and bandwidth. Our design realizes this by selecting 
the objective loop transfer functions in (10.30) in which each factor reflects 
respective roles of delay, non-minimum-phase zeros and bandwidth. It might 
be worth noting that decoupling and loop performance may not always be in 
conflict. It is shown (Linnemann and Wang, 1993) that for delay-free stable 
systems some optimal controllers will automatically result in decoupled loops 
although decoupling is not required in the problem formulation. 

For a multivariable multi-delay process, the IMG controller designed by the 
above procedure is usually in the complicated form (10.16), which is difficult to 




288 10. Multivariable Systems 



implement. Model reduction is then employed to find a much simpler rational 
function plus dead time approximation to the above theoretical controller. The 
topic of model reduction has been addressed in Chapter 2 in a great detail and 
two effective algorithms were given there. We can utilize one of them for our 
present design. 

Theoretically, if ha is specified as in (10.30) so that it contains no more 
time delays than necessary, then each column of C has at least one element 
whose time delay is zero. However, if the controller is obtained as a result of 
model reduction, that element might have non-zero time delay, though it is 
usually small. In such a case, it is reasonable to subtract it from all elements 
in the column to speed up the loop response if it is positive or to make the 
controller realizable if it is negative. This operation will not affect decoupling 
and stability. The above development is summarized into the following design 
procedure. 

IMC Design Procedure Seek a controller C{s) given G{s) 

(i) With i = 1 for loop one, apply model reduction to \G\ and all nonzero G^K 
Take time delays and non-minimum-phase zeros {including multiplicities) 
from their reduced-order models. Find 7 ^ and rji{z) for all z G Zj^| from 
(10.19) and (10.23). 

(a) Specify ha according to (10.30) and determine the diagonal controller cu 
from (10.31). Apply model reduction to cu to obtain cu. 

(Hi) Calculate the controller off-diagonal elements cji from (10.12). Apply 
model reduction to all cji to obtain Cji. 

{iv) Find the smallest time delay in cji and subtract it from all the time delays 
of Cji if it is nonzero. 

(v) Repeat the above steps for all other loops. 

The IMC system in Figure 10.1 is referred to as the nominal case ifG = G. It 
is obvious that the IMC system is nominally stable if both the process G and the 
controller C are stable, as discussed before. In the real world where the model 
does not represent the process exactly, nominal stability is not sufficient and 
robust stability of the IMC system has to be ensured. As a standard assumption 
in robust analysis, we assume that the nominal IMC system is stable (i.e., both 
G and C are stable). Suppose that the actual process G is also stable and is 
described by 

G e n = {G : ^ ([G(ja;) - G{ju)]G-\jij)) = a (AM) < IM), 

where lm{^) is the bound on the multiplicative uncertainty. It follows that the 
IMC system is robust stable if and only if 
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a(Gijuj)Cijuj)) < Vw. (10.32) 

Let (7* be the ideal controller obtained from (10.31) and (10.12), we have 
GC* = diagjhii}. Thus (10.32) becomes 

a (diag {hu{juj)}C*~'^{ju})C{jujfj < Vo;. 

One notes from (10.30) that dia.g {hu{juj)} = Vdia,g{fi{juj)}, where F is a 
unitary matrix. Noticing that aiy A) = '^{A) for a unitary V ^ a sufficient and 
necessary robust stability condition is obtained as 

a (diag{/i(jo;)}C*“^(jw)C'(ja;)) < Vw. (10.33) 

In practice, we can evaluate and plot the left-hand side of (10.33) and compare 
it with to see whether robust stability is satisfied given the multiplica- 

tive uncertainty bound lm{j^)- One also notes that if the error between the 
ideal controller C* and its reduced-order model C is small, i.e., C* (7, then 
the robust stability condition becomes 

a (diag {fi{ju)}) < Vw, 

which indicates that the IMG filter should be chosen such that its largest sin- 
gular value is smaller than the inverse of the uncertainty magnitude for all 



10.1.4 Simulation 

In this subsection, several simulation examples are given to show the effec- 
tiveness of the decoupling IMG design. The effects of time delays and non- 
minimum-phase zeros are illustrated and control performance as well as its ro- 
bustness is compared with the existing multivariable Smith predictor schemes. 
We intend to use commonly cited literature examples with real live background 
and try to explain technical points of the proposed method as much as possi- 
ble. The first and third examples are well-known distillation column processes 
(Wood and Berry, 1973) and (Luyben, 1986). The process in the second ex- 
ample is a modification of the Wood and Berry process where only the delays 
of its elements have been changed. This modification generates non-minimum- 
phase zeros for the multivariable process, which is not available in the other 
two examples, and is used to illustrate relevant design issues. 

Example 10.1.1. Gonsider the well-known Wood/Berry binary distillation col- 
umn plant (Wood and Berry, 1973): 




290 10. Multivariable Systems 



G(s) 



12.8e" 
•7s + 1 



. 6.6e"^* 
LlU.9s + l 



-18.9e“®n 

21s + 1 



-19.4e“^* I 
14.4s + 1 J 



Step (i) The application of model reduction to |G|, G^^ and G^^ produces 



1G| = 



-0.1077s2 - 4.239s - 0.3881 _e .33 
s2 + 0.1031s + 0.0031 ® 



^11 _ -1.349s -42.81 _3, 

“ s2 + 31.85s + 2.207® ’ 

^12 _ -0.6076s - 17.66 

“ s2 + 29.26s + 2.676® ' 

It is clear that 7(|G|) = 6.3, j(G^^) = 3, and = 7. Thus, by (10.19), 

one finds 71 = min{3, 7} = 3. Since |G| is of minimum phase, Zjt ^ = 0 and 
there is no need to calculate rji(z). 

Step (a) According to (10.30), we have hu = ^777- with the filter chosen 
<^11 is then obtained as cn = 9 iihu from (10.31). The application of 
model reduction to cn yields 

O.3I6852 -h 0.03515 + 0.0012 0 

C 11 = e 

s2 + 0.1678s + 0.0074 

Step {Hi) C21 is calculated from (10.12). Applying model reduction to C21 yields 

. _ 0.1405 s 2 + 0.0180s + 0.0007 _4.9, 

^21 - g 2 + 0.2013s + 0.0123 ® 

Step (iv) The smallest time delay in cn and C21 is 0.9, which is then subtracted 
from both elements’ time delays to generate the final cn and C21. 

Step (v) Loop two is treated similarly, where ^22 = results in the 

overall controller as 

0.31685^ + 0.0351s + 0.0021 -0.2130s^ - 0.0222s - 0.0008 - 2 / 

s^ + 0.1678s + 0.0074 s'^ + 0.1399s + 0.0051 

O — 

0.1405s^ + 0.0180s + 0.0007 -4., -0.1798s^ - 0.0206s - 0.0008 

. s^ + 0.2031s + 0.0123 s^ + 0.1607s + 0.0073 

The set-point responses of the resulting IMG system (shorten to IMG) are 
shown in Figure 10.2 as a solid line. The corresponding set-point response 
of Jerome’s multivariable Smith predictor scheme with the controller settings 
given in Jerome and Ray (1986) is depicted as the dashed line in the figure. 
The corresponding responses of the ideal IMG system H{s) = diag{/iu} are 
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also shown as the dotted line in the figure. The resulting ISE (Integral Square 
Error) with equal weighting of the two outputs is calculated as 7.16, 4.73 and 
5.01 for the IMC design, Jerome’s scheme and the ideal IMC control system, 
respectively. Although the ISE for Jerome’s scheme is smaller than that of the 
proposed method, Jerome’s control system is not robust and exhibits very poor 
damping and severe oscillation even for the nominal case, while the responses 
of the IMC are smooth and the decoupling is almost perfect. 





Fig. 10.4. Control system robustness for Example 10.1.1 

( IMC; Jerome) 



In order to demonstrate the robustness of the IMC design, we increase the 
dead times of the process diagonal elements by 15%. In order to check the sta- 
bility of the perturbed system, the left-hand side and right-hand side of (10.33) 
are plotted in Figure 10.3 as a solid line and dashed line respectively. From the 
figure, we conclude that the IMC system remains stable under the given per- 
turbations. The set-point responses are shown in Figure 10.4, indicating that 
the performance of the IMC design is far superior to Jerome’s multivariable 
Smith predictor scheme. The resulting ISE is calculated as 7.76 for the IMC 
method while it is infinite for Jerome’s scheme due to instablity. 
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Example 10.1.2. Consider a variation of the above example: 



G(s) = 



Piio(s)e « 
52io(s)e”^® 



9i2o{s)e 

</22o(s)e-i®« 



where the delay free parts gijo{s) are identical to Example 10.1.1. It follows 
from the IMG procedure that 

0.03745^ + 3.725 - 0.5042 .o g, 

I""' = .^ + 0-1239. + 0.0041 ^ - 



= 



-1.3493s -42.81 
s2 + 31.85s + 2.207® 



^12 ^ -0.6072s - 17.66 _2* 
s2 + 29.26s + 2.676® ' 

One readily sees that 7(|G|) = 13.6, 7(G^^) — 15, 7(G^^) = 2 and thus 
7i = min{15, 2} = 2 from (10.19). A difference from Example 10.1.1 is that |G| 
has a RHP zero at 2: == 0.136 with a multiplicity of one, i.e., Zj^| = {0.136} and 

r/^(|G|)U=o.i36 = 1-It is easy to find r7^(G^^)U=o.i36 = 0 and T7 ^(G^^)U=o. 136 = 
0 since and are both of minimum phase. We thus have t 7 i(^)|z=o .136 = 
min{0, 0} = 0 from (10.23) and hn = (0 i36+g)(g+i) from (10.30) with 

the filter of For the second loop, with the filter chosen as /122 is 
obtained as /122 = (0 i36+g)(5+i) design is straightforward 

and gives 

"0.36565^ + 0.05245 + 0.002 -13.1s -0.2375s‘^ - 0.02945 - O.OOll ^-ss 
^ _ 5*^ + 0.22655 + 0.0124 5^ + 0.17905 + 0.0070 

0.15515^ + 0.02915 + 0.012 -0.20035^ - 0.03175 - 0.0014 

5^ + 0.27265 + 0.0226 5^ + 0.22155 + 0.0136 

For comparison, Ogunnaike and Ray’s multivariable Smith predictor is con- 
sidered here, where the primary controller given in Ogunnaike and Ray (1979) 
can still be used since the delay-free part of the process is identical for our case 
and their case. The set-point responses shown in Figure 10.5 indicate that the 
performance of the proposed IMG design is significantly better and its response 
is very close to that of the ideal IMG controller (dotted line). The resulting ISE 
is calculated as 52.5, 71.16 and 49.4 for the IMG, Ogunnaike and Ray’s scheme, 
and the ideal IMG, respectively. 

Example 10.1.3. The process studied by Luyben (1986) has the following 
transfer function matrix: 
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Fig. 10.5. Control performance for Example 10.1.2 

( IMC; Ogunnaike and Ray; • • • ideal IMC) 



G{s) = 



0 . 126 e~^^ 

eus + 1 (45s + l)(48s + 1) 

0.094e~^^ -0.12e~^^ 

38s “l“"I 35s “h”*! 



It follows from the design procedure that with filters chosen as /i(s) = / 2 (a) = 
3 ^, hn and /i 22 are obtained as hu = and /122 = respectively. 

The resultant controller is 

~ 146.8s^ + 6.355s 4- 0.0733 -6.027s^ - 0.3416s - 0.0053 -9..s/ 

^ _ s^ + 0.3465s + 0.0034 s^ + 0.0395s + 0.0003 

104.5s^ + 4.719s + 0.0561 -68.2s^ - 3.490s - 0.0527 

. + 0.34s + 0.0034 s^ + 0.2496s + 0.0024 

Since the multivariable Smith predictor design for this process is not available in 
the literature, the BLT tuning method (Luyben, 1986) is used for comparison. 
The set-point responses are shown in Figure 10.6, indicating that significant 
performance improvement has been achieved with the IMC design and again 
its response is very close to that of the ideal IMC system. The resulting ISE 




10.1 IMC Scheme 295 




y2 



1.5 

1 

0.5 

0 

- 0.5 



1 \ r 


1 1 

1 






, \ 


' 


I \ 


/ 




1 







100 



200 



300 



400 



500 



Fig. 10.6. Control performance for Example 10.1.3 

( IMC; - - - BLT; • • • ideal IMC) 



600 



is calculated as 17.7, 51.5 and 17.0 for the IMC, BLT, and ideal IMC system, 
respectively. 

In this section, an approach to the decoupling and stable IMC analysis and 
design has been presented for multivariable processes with multiple time de- 
lays. All the stabilizing controllers which solve this decoupling problem and the 
resultant closed-loop systems are characterized in terms of their unavoidable 
time delays and non-minimum-phase zeros. Such delays and zeros can be read- 
ily calculated from the process transfer function matrix and clearly quantify 
performance limitations for any multivariable IMC system which is decoupled 
and stable. It is interesting to note that a controller may necessarily include 
some time delays and non-minimum-phase zeros to make itself a solution to 
the problem. A theoretical control design for the best achievable performance 
is carried out based on the characterizations. Model reduction is then exploited 
to simplify both analysis and design. Examples have been given to illustrate our 
approach and significant performance improvement over existing multivariable 
Smith predictor control methods is evident. 
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10.2 Unity Feedback System 

In this section, we design a multivariable controller design in the conventional 
unity output feedback configuration, based on the IMC design of Section 10.1. 
Experience gained through implementation of this method for various industrial 
chemical processes reveals that a high-order controller with integrator is more 
appropriate for complex multivariable processes than the PID controller. This 
is because a complex process may give rise to very complicated equivalent loops 
for which PID control is difficult to handle. 

10.2.1 Design Methodology 

Like the SISO case presented in Chapter 9, we use the IMC controller to derive 
the single-loop controller, taking into account the performance limitations im- 
posed by the single-loop feedback structure when tuning the filter parameters. 
Let the closed-loop transfer function between r and y be specified as in (10.30), 
which is repeated for easy reference as follows: 

H{s) - diag{/iii}, 

ft,, = n i—J ’ (10.30) 

where fi{s) is the ith loop IMC filter and chosen throughout this section simply 
as 

Ms) = (10.34) 

where Ti is the only tuning parameter for each loop to be selected by the user to 
achieve the appropriate compromise between performance and robustness and 
to keep the action of the manipulated variable within bounds. Once hu{s) are 
determined, cu{s) are obtained from (10.31), which in turn yield off-diagonal 
elements Cji{s) uniquely by (10.12). 

The IMC system in Figure 10.1 can be formally redrawn into the equivalent 
conventional feedback system in Figure 10.7, if the feedback controller K is 
related to the IMC controller C via 



i.e.. 



K ^C[I-GC]-\ 



(10.35) 
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Fig. 10.7. Conventional feedback control 



kii — 



1 — -^c-- 

U.. - 

M.r-- 

riii 



hii G” 

1 - hii \G\ ’ 
-^hi, j i- 



(10.36) 

(10.37) 



Thus, the open-loop transfer matrix of the conventional feedback system, Q = 
{qij} = GK, must be diagonal: 



GK = diag{^fcii} = diag | 




(10.38) 



With hii specified as in (10.30), the ideal diagonal elements of the controller 
can be obtained from (10.36). The corresponding decoupling off-diagonal ele- 
ments kji{s) of the controller are determined individually by solving (10.37). 
However, the ideal controller K above, is generally highly complicated and/or 
unrealizable. We use the same design idea as adopted in the SISO case of 
Chapter 9 to obtain the best approximation ^ to FT to ensure the closed-loop 
performance. The diflFerence from the SISO case is that both the decoupling per- 
formance and the approximation accuracy should be considered in the tuning 
process. If each loop approximation and/or the overall decoupling performance 
are not satisfactory, we adjust the IMC controller performance down or increase 
the controller complexity. 

To find a reasonable feedback controller approximation to the corresponding 
IMC one, it is necessary to obtain a suitable value for In SISO applications, 
performance limitations of single-loop feedback systems due to non-minimum- 
phase zero and dead time have been considered, and a guideline for tuning 
IMC filters has been derived, which is also applicable to the present case of 
decoupled MIMO systems. The gain crossover frequency ujogi of the ith ideal 
open-loop transfer function where 



hji{juJogi^ Tj) 

1 kii{juJog^'^i) 



(10.39) 
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should meet 

arg > -18O°+0„, (10.40) 

to have the desired phase margin of (j)m- Our studies suggest that (prn = 65° will 
usually be a good choice for most 2 by 2 industrial processes, whereas a larger 
(f)rm such as = 70°, will be necessary for 3 by 3 or even 4 by 4 processes. 

To consider the performance limitation imposed by input constraints, we use 
a frequency-by-frequency analysis. Assume that at each frequency \ui{juj)\ < 
Ui and that the model has been appropriately scaled such that the reference 
signal in each channel satisfies \ri{j(j)\ < 1. Now consider the presence of a 
reference signal in a channel at a time the ideal controlled variable y would 
he y = [0 • • • huri • • • 0]^, and thus the corresponding manipulated variable 
becomes 

u = G~^y = G~^[h • • • hiiVi • • • 0 ]^ 



i.e., 



G^j 

'^j — 1^1 huri. 

Consider the worst-case references {\ri{juj)\ = 1); we require 
G^j 

< Uj^ j € Ji, 



or 



\hii\ <min{|^|tx^}. 



To derive an inequality on imposed by input constraints, note from (10.30) 
and (10.34) thdit \hu{j ^)\ = ai oj = ^ gives 






< mm{ • 



,}• 



(10.41) 



We may simply plot the right hand-side of (10.41) and determine when the 
inequality holds to find the suitable range of r*. 

In order to have the fastest response while having a given stability margin 
and meeting input constraints, the tuning parameter ri in the filter (10.34) 
should be chosen to be the smallest that meets (10.39), (10.40) and (10.41) 
simultaneously. In the subsequent two subsections, PID and general controllers 
are considered, respectively. 
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10.2.2 PID Controller 

Consider a multivariable PID controller in the form 

— kpij kjij ~ hf)ij s . (10.42) 

Our task is to find PID parameters so as to match kij to kij = 
as well as possible. This objective can be realized by minimizing the loss func- 
tion, 

L 

minJ = min^ (10.43) 

kij kij 

subject to the same sign for kpij, knj, and koij. This problem can be solved 
by standard non-negative least squares (Lawson and Hanson, 1974) to give the 
optimal PID parameters. Here, the fitting frequencies (cJi ^ ojl) are chosen 
as (uJbmax/^00, Ubmax), where uJbmax is the maximum closed-loop bandwidth 
among all the loops, i.e., cobmax = max(c(;6e) = max(;^). 

In MIMO systems, it might happen that the loop performance is satisfactory 
while the interactions are too great to be accepted. Let 

(10.44) 

To ensure both decoupling and loop performance, we require that for 5 G i? 



I7DD |9m(s) - 9«(«)| ^ W ^ 

ERRoi := max < Coi, Vz G m, 

qu{s) 


(10.45) 


El9ji(s)l 




ERRdi := max ' , . , < Cdi, Vi € m, 

l9«(s)l 


(10.46) 



where Cdi and Coi are the specified performance requirements on the loop inter- 
actions and loop performance, respectively. 

Usually, both Coi and Cdi may be set as 10%. If both (10.45) and (10.46) 
hold true, the design is completed. Otherwise, one can always detune PID by 
relaxing the IMC specification, i.e., increasing r*. Our detuning rule is 

max( 7 (|G|) - 7 i, min (Re ( 2 ))), (10.47) 

^ez+i 

where k represents the fcth iteration, and rji is an adjustable factor of the 
ith-loop refiecting both the approximation accuracy and the decoupling per- 
formance of the present iteration and is set as 
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T)i = max{7]oi, 7]di}, 



where 



fo if ERRni < 10%, 

if ERRdi < 10%, 
if 10% < ERRdi. 

[1 if 100% <ERRoi, 



Voi = < 



I if 10% < ERRoi < 50%, 
i if 50% < ERRoi < 100%, 



and 



m 



The iteration continues until both (10.45) and (10.46) are satisfied. 

We now present some simulation examples to demonstrate our PID tuning 
algorithm and compare it with the multivariable PID controller design in Dong 
and Brosilow (1997), who used the following PID form: 



K = Kp + Ki- + ^^ (10.48) 

s as + 1 

with a = max{{Kp^ Koiij j)) /20} if K~^ exists. The ideal PID controller in 
(10.42) is not physically realizable and thus is replaced by 

kij (s) = kpij + ki ij - + • 

The simulation is done under the perfect model matching condition, i.e., G = G 
(model mismatch will be considered in Section 10.2.4). 



Example 10.2.1. Consider the plant in Luyben (1986): 
r -2.2e“" 1.3e-^'^"l 



G(.)- 



TiTT" “TiTT 



-2.8e~^-^^ 4.3e~Q- 

9.5s 1 9.2s 4^ 



Following the procedure in Section 10.1, we have hn = ^22 = rls^-iri ' 

Prom (10.39), (10.40) and (10.41), the initial ti are obtained as = 1.0143 
and = 0.6821. The proposed method results in the overall controller: 



k = 



-1.833 - ^ - 1.042s 0.663 + ^ + 0.610s 
-0.646 - ^ 1.398 + ^ 



with ERRoi = 31.76%, ERR 02 = 93.23%, ERRdi = 42.14% and ERRd 2 = 
43.31%. Dong’s method generates the PID controller parameters as 





-2.418 1.873 




-0.367 0.216 




0.188 -0.558 


Kp = 


-1.312 3.151 


, Ki = 


-0.239 0.366 


, Kd = 


1.040 -1.102 
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Since the derivative terms obtained using Dong’s method have different signs 
from other terms in a single PID, we use PI instead of PID controller for 
this case, as suggested by Dong and Brosilow (1997). The step responses in 
Figure 10.8(a) show that both the proposed PID controller and Dong’s PI 
controller cannot yield good loop performance. Based on the proposed tuning 
procedure, are increased until the approximation error and the decouping 
index are small enough to satisfy (10.45) and (10.46), respectively. We end 
with Ti = 6.0143, T2 = 5.9321 and the overall controller 

-0.669 - ^ - 0.507s 0.270 + ^ + 0.428s 
K = ^ ^ 

-0.317 - 2^ 0.426 + 2^ 

with ERRoi = 9.05%, ERR 02 = 6.38%, ERRdi = 7.70% and ERRd 2 = 5.58%. 
Dong’s method with the same new r, yields 





-0.676 0.306 




-0.105 0.036 




0.172 -0.107 


kp = 


-0.365 0.515 


, ki = 


-0.069 0.060 


,Kd = 


0.362 -0.206 



although Dong and Brosilow (1997) did not suggest any detuning rule there. 
The closed-loop step responses are shown in Figure 10.8(b). One observes that 
the performances of both methods are almost identical to the IMG system (not 
shown for simplicity). 



Example 10.2.2. Consider the 3x3 plant presented by Vasnani (1994): 



G{s) = 



119e“®* 
21.7s H-1 

77e“^® 
50s + 1 

93e-®* 
50s + 1 



40e“^* 
337s + 1 

76.7e“^* 
28s + 1 



-2.1e“®* ■> 
10s + 1 

-5e-^* 

10s + 1 



-36.7e-^® -103.3e“^® 

166s 1 23s -Fl , 



It follows that hii = 77^, /122 = and hzz = The guideline for 

tuning IMG filters gives ri = 6.85, T2 = 4.90, tz = 6.60. This results in the 
proposed multivariable PID controller 



21.8 -b 2^ -f 26.8s -1.4- 2T _ 0.9s 0.0002 -b2fi 

.^ = 10“3x| -9.8-2^ 59.3 + M -p 40.4s -4.1 - 2T 

9.3 + 2^ -b 1.5s -3.2-2^ -27.8 - - 24.7s 



with ERRoi = 4.33%, ERR 02 = 2.64%, ERRoz = 1.95%, ERRdi = 4.58%, 
ERRd 2 = 3.41% and ERRds = 5.95%. Dong’s method yields 
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-0.144 


0.365 -0.010 




1.1 -0.8 0.01 


kp = 


0.153 


-0.301 0.007 


X 

CO 

1 

O 

T— 1 

II 


-1.0 2.4 -0.1 




-0.260 


0.578 -0.036 




1.3 -1.6 -0.9 



Kd 



79.312 -180.405 4.583 
-76.487 173.189 -4.409 , 
119.610 -269.632 6.804 



which leads to an unstable closed loop. When we eliminate one of the three 
parameters that has a different sign from the other two elements in kij^ a 
stable step response can be obtained as shown in Figure 10.9. It can be seen 
that the proposed method shows much better performance than Dong’s design. 



Generally, an equivalent process after decoupling a significantly interactive 
multivariable process becomes highly complicated. Though one can always de- 
tune the PID controller to a sufficient extent to generate a stable closed loop, 
a sluggish response must result. This is because a PID controller is too simple 
to re-shape complicated dynamics satisfactorily over a large frequency range 
for high performance. In such a case, a more complex controller than PID is 
necessary. 



10.2.3 High-order Controller 



In this subsection, we consider controller elements kij in the form of an nth- 
order rational transfer function plus a time delay Lij : 



“b ^ “b •.. + bujS + boij 

S'^ -f- an-lijS'^-'^ + ... -h aiijS 



(10.49) 



which needs to approximate the ideal kij as well as possible. The recursive 
least squares (RLS) algorithm for transfer function modelling from the fre- 
quency response presented in Chapter 7 can be applied to obtain the solution. 
Like the LS algorithm, the frequency range for RLS fitting is also chosen as 
(^6max/100, oJbmax) with steps of ~ ^)uJbmax- In this range, the RLS 
yields satisfactory fitting results in the frequency domain. The orders of the 
rational parts of the controller elements are determined to be the lowest such 
that for s G i?, a set of performance specifications on loop performance (10.45) 
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Fig. 10.9. Step response for Example 10.2.2 

( proposed PID, Dong’s PID) 



and loop interaction (10.46) are satisfied. The controller design procedure can 
be summarized as follows. 

IMC-based MIMO design procedure 

Seek a feedback controller K{s) given G{s): 

Step 1. Specify ha in (10.30) with the method in Section 10.1 and fi chosen 
as in (10.34). Determine the smallest r* for each loop according to 
(10.39), (10.40) and (10.41), and set rf = rf . 

Step 2. Find the PID controller using the LS method and evaluate ERRoi in 
(10.45) and ERRdi in (10.46). If ERRoi and ERRdi meet the specified 
accuracy Coi and Cdi (usually lOYo) respectively, end the design. 

Step 3. Otherwise, we have two options: if a PID controller is desired, update 
Ti by (10.47), and go to Step 2; else, go to Step 4- 
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Step 4. Adopt the high-order controller in (10.49); for each kij, start from a 
controller order of 2, apply the RLS to obtain kij, increase n until the 
smallest integer n is reached with (10.45) and (10.46) satisfied. 

In this subsection, apart from 2 by 2 processes, examples of 3 by 3 and 4 
by 4 processes are also given to show the effectiveness of the proposed design. 

Example 10.2.1 (cont’d). Reconsider G in Example 10.2.1. With = 1.0143 
and T 2 — 0.6821, a multivariable PID controller has been obtained there with 
with ERRqi = 31.76%, ERRq 2 — 93.23%, ERR^i = 42.14% and ERRd 2 = 
43.31%. For a high-order controller, our procedure gives 

" -2.0545^ - 1.4005 - 0.148 1.0055^ + 0.1595 - 0.001 

+ 0.422s + 0.024s 

-1.484g- 0.241 ,-i.5« 1.226s^ + 2.468s + 0.260 „-o.5« 

L « + 1.187s J 

with ERRqi = 7.71%, ERRq 2 — 1.61%, ERR^i — 2.88%, and ERR(i 2 — 
3.25%. The step response is shown in Figure 10.10. Compared with the PID 
performance, we can see that the high-order controller gives much improved 
loop and decoupling performance. 





Fig. 10.10. Step response for Example 10.2.1 (continued) 

( proposed high-order, proposed PID, Dong’s PID) 
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Example 10.2.3. The process studied by Luyben (1986) has the following 
transfer function matrix: 



G(.) 



"(U26^ -Q.101e~^^^ 

60s -hi (45s -h l)(48s -h 1) 

Q.Q94e~^^ -Q.12e~^^ 

_ 38s “h 1 35s “h 1 



We have hn = and /122 = initial parameter values are rf = 

3.84 and = 5.37. The proposed IMC-based multivariable PID controller 
design method results in the overall controller: 



47.786 + ^ -h 98.940s 1.969 -h 8.186s 

34.617 -h ^ + 71.481s -22.903 - - 59.516s 



(10.50) 



with ERRoi = 13.56%, ERR 02 = 25.37%, ERRdi = 0.91% and ERRd 2 = 
96.83%. Dong’s method generates 





-19.610 94.639 




2.168 -1.343 


Kp = 


-23.851 56.086 


, Ki = 


1.698 -1.675 



and 



Kd = 10 ^* 



6.587 -9.443 
5.444 -7.948 



Our PID cannot achieve the decoupling performance specified, as shown in 
Figure 10.11, while Dong’s PID controller results in an unstable closed loop 
in this case. There is little benefit to be gained by increasing ri and T 2 . This 
is because the Nyquist curve of a PID controller is a vertical line in the com- 
plex plane and usually not sufficient to compensate for significant interactions. 
Therefore, we have to adopt a high-order controller to meet the requirement. 
With the same r^, the resultant controller is 

r 87.0365^+16. 852g+0.616 -1.4975^-0.4745-0.014 -6.45 1 

52+0.3865 5^+0.0105 ^ 



61.4345^+11.4245+0.446 -131.6045^-40.7735^-1.8875-0.015 
L 52+0.3625 53+1. 82152+0.0045 J 

with ERRqi = 1.36%, ERRq 2 — 2.02%, ERRdi — 2.08% and ERRd 2 — 0.86%. 
The step response is shown as the solid line in Figure 10.11. We can see that 
the new controller K yields satisfactory performance, while the PID controller 
in (10.50) is not capable of that. 
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Fig. 10.11. Step response for Example 10.2.3 

( proposed high-order, proposed PID) 



Example 10.2.4- Consider the Tyreus distillation column (Tyreus, 1982): 



G{s) = 



L986elf:!i! 
66.7s + 1 

-0.0204e~°°^^ 
(7.14s + 1)''^ 

-0.374e“^-’’®* 
22.22s + 1 



-5.24e“®°* 
40Us + 1 

0.33e~°-^^^ 
(2.38s + 1)^ 

(21.74s + 1)^ 



-5.984e“2-2^®'' 
14.29s + I 

-0.0159e-2i» 

ID5TT 

9.811e“^®®* 
11.36s + 1 



It follows that hn = 



(-S+3.0274) 
(s+3.0274)(n s+1)^ 



13.4s 

j 



1^22 



(-5+3.0274) 8.7s 

(s+3.0274)(t2S+1) ’ 



and 



/133 = (g +3 0 j 74 )^(rl ~ t+^ ^ 13.65 initial Ti are calculated as rf = 17.50, = 

11.90, and Tg = 17.70. The resultant elements of the high-order controller by 



the proposed method are 
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k\i 

k2i 

ksi 



1.4990s^ + 0.18295^ + 0.0157s^ + 0.0002s + 4 x 10"^ _i 3 . 4 s 
+ 0.1226s3 + 0.0129«2 + 3 x IQ-^s ® 

-0.0541s^ + 0.0112s® + 0.0012s® + 2 x 10“®s + 4 x 10“® _6.i. 
s4 + 0.1261s3 + 0.0237s2 + 6 x 10-®s ® 

0.0241s^ + O.OOlOs^ + 0.0002s® - 4 x 10“®s® - 1 x 10^'^s - 2 x 10"^“ _i 9 . 



19.6s 



s4 + 0.2674s® + 0.0277s2 + 0.0020s + 4 x lO-^s 



fel2 = 



0.9397s® - 0.2847s'* - 0.0058s® - 0.0061s® - 0.0001s - 6 x 10“® _g 
s5 + 0.1793s4 + 0.0252s® + 0.0020s^ + 5 x 10“®s ® 



j _ 1.2078s® + 0.1106s + 0.0037 __ 8 . 7 , 
®® “ g 2 + 0.2695s ® 



ks2 = 



0.0468s^ - 0.0159s® - 0.0007s® - 4 x 10“®s - 7 x 10“® 
s* + 0.0462s3 + 0.0022s2 + 4 x lO-^s ' 



fcl3 = 



0.2547s® + 0.0276s® + 0.0009s + 3 x 10'® _i 2 .u 
s3 + 0.0932s® + 0.0121s ® 



^23 = 



0.3978s® + 0.0248s + 0.0007 
s2 + 0.2283s ‘ 



f _ 0.0876s® + 0.0064s + 0.0002 _i 3 . 6 , 
“ s2 + 0.4495s ® 



with ERRoi = 0.31%, ERR02 = 3.41%, ERRoz = 5.78%, ERRdi = 1.25%, 
ERRd 2 — 2.96% and ERRds = 4.42%. The step response is shown in Fig- 
ure 10.12, and has excellent performance. It should be pointed out that no 
stabilizing PID controller could be obtained until the closed-loop is so sluggish 
that it is virtually useless and cannot be shown in the figure. 



Example 10.2.5. Consider the 4 by 4 distillation column of Doukas and Luyben 
(1978): 



G{s) 



' -11.3e~^-^^® 
(21.74s + 1)® 

5.24e~^° 
(400s + 1) 

-0.33e~°-^®f 
(2.38s + I)"" 

4.48e~°-^^^ 

_ (11.11s + 1) 



0.374e~’’-^^* 


-9.811e'^®®* 


(22.2s + 1)^ 


11.36s 4“ 1 


-1.986e"°'^^® 


5.984e'®®^* 


(66.67s + 1)^ 


14.29s + 1 


0.0204e'°-^®® 


2.38e'°-^®* 


(7.14s + 1)® 


(1.43s + 1)® 


-0.176e'°-^®* 


-11.67e'^®^* 


(6.90s + 1)® 


(12.19s + 1) 



-2.37e"2'^®®*l 



■33.'3's + 1 



0.422e~®-^^® 
(250s + 1)® 



0.513e-* 



15.54e- 
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Fig. 10.12. Step response for Example 10.2.4 



We have hn — 
and /i 44 = 



1 



(t4S+1) 



(ris+1)^ 
^-8. 17s 



h22 



_ 1 



. The initial r* are 



(t2S+1) 

0 . 



^33 = 



0-17. 48s 



(t3S+1) 

23.90, T2° = 23.30, = 23.30 



r° - 
^4 — 

proposed method are 



and T 4 = 10.80. The resultant elements of the high-order controller using the 
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_ 0.624s® - 0.0528s^ - 0.0193s® - 0.0024s® - 0.0001s - 6 x 10“® _ 6 . 9 , 

“ s® + 1.073s4 + 0.133s3+0.0254s2+0.0003s ® 

1.001s® + 1.004s® + 0.883s® - 0.221s^ - 0.007s® - 0.0004s® - 7 x 10'®s 

-5 X 10“® 

s® + l.Olls® + 0.909s® + 0.292s^ + 0.0292s® + 0.003s^ + 8 x 10-«s 

_ 0.571s® + 0.0079s^ - 0.0122s® - 0.0014s® - 3 x 10~®s - 4 x 10~® _ 9 . 9 , 
s® + 0.974s'* + 1.069s3+0.155s2+0.0002s ® 

_ -0.0068s® + 0.0003s^ + 0.0001s® + 5 x 10“®s® + 6 x 10“®s + 2 x 10"® 
s® + 0.177s^ + 0.0467s® + 0.0041s2 + 0.0003s ® 

_ 0.0842s® - 0.0398s^ + 0.0237s® - 0.0057s® - 0.0002s - 2 x 10“® _i.u 
“ s5 + 0.636s4 + 0.238s3 + 0.0406s2 + 0.0035s ® 

_ -11.538s® - 0.427s® - 0.004s - 1 x 10“® _g, 7 , 
s3 + 0.231s2 + 0.0007s ® 

_ 0.0594s® + 0.0587s^ - 0.0058s® + 0.0022s® + 0.0001s + 6 x 10“® _i 5 . 3 , 
s5 + 1.035s4 + 1.162s® +0.214s2 + 0.0124s ® 

_ 0.0067s^ - 0.0019s® + 2 x 10-®s® + 3 x 10“®s + 3 x 10“® _ 4 . 5 , 
s* + 0.343s® + 0.0282s® + 0.0009s ® 

_ 0.982s® + 0.607s® - 0.184s^ - 0.0132s® - 0.0017s® - 0.0001s - 2 x lO'® 
s® + 0.980s® + 0.422s^ + 0.0993s® + 0.0075s2 + 2 x 10-®s 

_ 9.820s® + 0.328s® + 0.0018s - 8 x 10“® 
s® + 0.0694s® + 2 X 10-®s ® 

^ 0.120s® + 0.0201s + 0.0018 _ 2 i. 2 , 
s® + 0.166s 

_ -0.0365s® + 0.0057s® + 0.0011s + 0.0001 _g. 9 , 
s® + 0.169s® + 0.0067s ® 

_ -0.0439s^ - 0.0031s® - 0.0003s® - 4 x 10“®s -lx 10“® _ 5 . 6 s 
s^ + 0.204s® + 0.0256s® + 5 x 10-®s ^ 

_ 0.529s® + 0.0109s® + 0.0001s - 2 x 10“® 
s® + 0.0336s® + 0.0001s ® 

-0.0023s + 0.0007 _s. 



-0.0087s® + 0.0027s® + 0.0003s + 1 x 10' 
s® + 0.0692s® + 0.0003s 



with ERRdi = 0.33%, ERRg 2 = 9.52%, ERRgz = 3.05%, ERRoi = 0.08%, 
ERRai = 7.08%, ERRdz = 4.84%, ERR^z = 8.52% and ERR^i = 6.53%. The 
step response is shown in Figure 10.13, and the effectiveness of the controller 
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is evident. Like Example 10.2.4, no reasonable PID controller could be found 
for this example. 




Fig. 10.13. Step response for Example 10.2.5 



10.2.4 Stability Analysis 

In this subsection, we consider both nominal stability {G = G) and robust sta- 
bility {G ^ G). First, assume G = G in the absence of model uncertainty. As 
the process G{s) is assumed to be stable and the controller K{s) is designed 
to contain no poles in the right half of the complex plane except the origin, ac- 
cording to the generalized Nyquist theorem (with the Nyquist contour indented 
to the right around the origin) (Maciejowski, 1989), the closed-loop system is 
stable if and only if the characteristic loci of G{s)K{s), or Q(s), taken together, 
do not encircle the point —1. 
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Thus, in principle, with the generalized Nyquist theorem, the nominal sta- 
bility of the system can be determined by calculating the characteristic loci 
of Q and counting their encirclements of the point —1. However, it is not 
easy to calculate the characteristic loci, especially for processes with many in- 
puts/outputs. Notice that we are adopting a decoupling design, and as a result, 
the compensated open-loop transfer function Q{s) is likely to have a high de- 
gree of column dominance, and its Gershgorin bands will be generally narrow. 
By Gershgorin’s theorem (Maciejowski, 1989), we know that the union of the 
Gershgorin bands ’’trap” the union of the characteristic loci, and we can as- 
sess closed-loop stability by counting the encirclements of — 1 by the Gershorin 
bands, if they exclude -1, since this tells us the number of encirclements made 
by the characteristic loci. Thus, the closed-loop system is stable if all the Ger- 
shgorin bands exclude and make no encirclements of the point —1. 

Note that the elements of G{s) are strictly proper and the elements of 
K{s) are designed to be proper. Then, qji, the elements of Q{s) = G{s)K, are 
also strictly proper, i.e., liuis-^oo Qji{s) = 0. Thus, ^ (where 

0 < e < 1) is likely to hold for 5 G i7, where i? denotes the compliment of i? in 
the Nyquist contour. We have the following theorem. 

Theorem 10.2.1. (Nominal Stability) Assume YlJLi \Qji{^)\ s G i? 

and i G m, then the multivariable closed-loop system in Figure 10.7 is nominally 
stable if for 5 G i? and each i G m, (10.45) and (10.46) are satisfied^ and 



\hii\{eoi + edi-\-^oi^di) <1? 5 G 17, 


(10.51) 


or 




^oi~^ ^di~^ ^oi^di 1* 


(10.52) 


Proof. By definition, the ith Gershgorin band of Q{s) is 




®er •— ^s£dG\^{s)^ 


(10.53) 


where 




= {zeC\ \z-qu\ < ^ lgji(s)|}- 


(10.54) 






Since (10.45) and (10.46) are satisfied for s G 17, we have for s G 17 
\^ii\ ~ \^ii ^ \QU ^ (1 I ? 



and 
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\QU ^ ^ \Qji I ^ ^ (10.55) 

Thus for 2 ^ G where 5 G i?, we have 

^ ^ \Qii~Qii\~^ ^ ^ \Qji\ — i,^oi~^^di~^^oi^di^\Q.ii\' 

If the condition in the theorem holds, then 

|ld"^u| ~ — ^ i^oi~^^di~^^oi^di)\Qii\ ^ Oj 

which means that the distance from qu to the point —1 is greater than that from 
Qii to any point in so that the Nyquist curve of qu and the ith Gershgorin 
band Gg^. have the same encirclements with respect to the point —1. 

Since < c, for s G i? and z G m, then for z G Gg^(s), where 

s G /?, we have 

\z\-\m\ < \z-qu\ < 

j¥^i 

and 



kl < \qu\ + Yl \^ji\ < e < 1, 

which implies that no encirclement can be made by the Gershgorin band. The 
same can be said for qu^ due to the assumed |g'n(s)| < 1 for s G /?. Thus, 
the Gershgorin bands make the same number of encirclements of the point — 1 
as the Q = dmg{qu} does, and the system is stable as = diag{/in} is so. 
Noticing \hu{jod)\ < 1, Vo;, (10.51) is true if 



^oi d-€di + €oiedi < 1 . 



(10.56) 



The proof is complete. 

In the proposed algorithm, both Coi and Cdi are usually set as 10%. Then 
(10.56) can be satisfied with a large margin and nominal stability of the de- 
signed multivariable system can be expected. 

In the real world where the model does not represent the process precisely, 
nominal stability is not sufficient, and robust stability of the closed loop has 
to be ensured. The multivariable control system in Figure 10.7 is referred to as 
being robustly stable if the closed loop is stable for all members of a family of 
possible processes. Let the actual process be denoted by G{s) and the nominal 
process still by G{s). The following assumptions are made. 
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Assumption 10.1 The actual process G{s) and the nominal process G{s) do 
not have any unstable poles. The actual process G{s) and the nominal process 
G{s) are strictly proper. 



Consider the family of stable processes fj with norm-bounded uncertainty 
described by 



n = {<5 = [m. 



' 9ijiM ' ' 



(jw)! < (5{u;)}, 



(10.57) 



where 6{u) is the bound on the multiplicative uncertainty Aij. Let the per- 
turbed open-loop transfer matrix GK{s) be denoted Q and its elements qji{s). 
As the elements of K{s) are designed to be proper, qji are thus strictly proper, 
i.e., lims^oo q]i{s) = 0. Thus, ^ (where 0 < e < 1) is likely to 

hold for 5 G /?. We have the following theorem. 



Theorem 10.2.2. (Robust Stability) Assume \Qji (5)1 < e, for s G i? 
and i G m, then the multivariable closed-loop system in Figure 10.7 is robustly 
stable for all processes in H if for s E and each i G m, (10.45) and (10.46) 
are satisfied, and 



|^n|(^oi+€di+eoi€di+5(l+eoi+edi)) <1, s G i?. (10.58) 

Proof. The ith Gershgorin band of the actual open-loop transfer matrix Q{s) 
is 



Ggy, — ^s£DGlr{s), 

where 

G'er(s) = {z&C\\z-qu\<Y^ l9jt(s)|}. 

Since (10.45) and (10.46) are satisfied for s G f?, we have for 5 G i? 
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Q.ii\ — \iMii Q.ii^ “b 

< \qu - qu\ + lz- qu\ 

^ \qu ~ qu \ ^ ^ \qji\ 

m mm 

— I 5^(1 ^il)9il^li ~ I + ^jl)9jl^li\ 

/=1 j^i 1=1 

m m m m 

^ \QU “ ^n| “I" I ^ ^ ^il9il^li \ ^ ^ \Qji \ “I" ^ ^ 1 ^ ^ ^jl9jl^n\ 

1=1 j^i j^i 1=1 

m 

^ “H ^ ^ \^jl9jl^li\ 

j,l=l 

m 

< {^oi + ^di + ^oi^di)\9ii I + *^y~! igjd 

j=i 

< {^oi + ^di + ^oi^di)\9ii \ + <^((1 + ^oi)\9ii\ + ^di\9ii\) 

< {^oi + ^di + ^oi^di + <^(1 + ^oi + ^di))\9ii\' 

It follows that 

\z-{-l\ = \{1 + qu) + {z - qu)\ 

^ |i "b qu\ qa\ 

> 1 1 4- I — ( ^oi “b ^di “b ^oi^di ^(1 ^oi + ^di))\qu\, 

which is positive, i.e., the portion of the Gershgorin bands for s G i? exclude 
the point —1 if (10.58) holds. 

Since Yl^i \Qji(^)\ < e, for s G i? and i G m, then for 2; G Ggy.(s), where 
5 G i7, we have 

\z\-\qu\ < \z-qu\ < Y^\qji\, 



giving 

kl < \qu\ + '^\qji\ < e < 1, 

or 



|2; + 1| > 0. 

Therefore, the Gershgorin bands will exclude —1 for all s on the Nyquist contour 
and will not change the number of encirclements of the point —1 compared with 
the nominal system. The system is robust stable. 
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Note that \hii{juj)\ < 1, Vo;, and it follows that (10.58) is true if 

^oi + ^di + ^oi^di + ( 1 + Coi ^Cdi) < 1, Vo;. (10.59) 

Let €oi = Cdi = 10%, then the robust stability of the closed-loop can be guar- 
anteed by 

(S(a;) < 64.92%. (10.60) 

Note that for 5{uj) = 0, i.e., in case of no process uncertainty, then the robust 
stability condition (10.59) is simplified to (10.56). 

Example 10.2.2 (cont’d). Reconsider Example 10.2.2. To demonstrate robust- 
ness, introduce a 20% perturbation in dead time L^j, and 50% perturbation 
gain of Qij. It can be easily calculated that \Aij{juj)\ < 55.98% for s £ fl. Thus 
robust stability can be guaranteed by our algorithm with Coi = Cdi = 10%. The 
closed-loop performance is shown in Figure 10.14, and the column Gershgorin 
bands are shown in Figure 10.15. One observes that the system is robustly 
stable, indeed. 
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(a) Gl 



(b) Gi 




Fig. 10.15. Column Gershgorin bands for Example 10.2.2 (continued) 



11. Partial Internal Model Control 



For open-loop stable processes, the IMC approach provides a very simple yet 
powerful parametrization of all stabilizing controllers. The IMC factorization 
procedure gives valuable insights into the inherent control limitations of par- 
ticular models. However, when open-loop unstable processes are considered, 
the original IMC structure cannot be used for control system implementation. 
This is because under the perfect match situation, the IMC system becomes 
an open-loop one and unstable processes are thus not stabilized at all. These 
unstable processes can be pre-stabilized using conventional feedback before the 
normal IMC structure is applied (Garcia and Morari, 1982). Chapter 9 has pre- 
sented an alternative IMC-based method to design the conventional single-loop 
feedback controller for the unstable process. The IMC frame is abandoned in 
implementation in this situation. 

In this chapter, a new IMC scheme is proposed to control unstable pro- 
cesses and to provide stability. In this scheme, the process transfer function 
model is expressed as the sum of two parts. One contains all the unstable poles 
of the process while the other is the stable part. Unlike the original IMC, in our 
method, only the stable part of the process model is used as the internal model. 
In the case of a perfect match, the stable part of the process is cancelled by the 
internal model. The anti-stable part, which contains all the unstable poles and 
is usually of low-order dynamics, remains in the closed loop and can easily be 
stabilized using a low-order controller such as PID. In this scheme, only part 
of the process model is used as the internal model. Thus, this new approach 
is named Partial Internal Model Control (PIMC). When a stable process is 
concerned, the PIMC becomes the IMC. The internal stability analysis of the 
proposed PIMC scheme shows that the PIMC system is internally stable when 
the primary controller stabilizes the anti-stable part of the process. Asymp- 
totic tracking and regulation can be achieved by the proposed PIMC system 
or a Modified PIMC (MPIMC) scheme. The primary controller design is not 
complicated. 
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The chapter is organized as follows. The original IMC method is briefly 
reviewed in Section 11.1 and the PIMC strategy is proposed in Section 11.2. In 
Section 11.3, the internal stability of the PIMC system is analyzed. In Section 
11.4, asymptotic tracking and regulation of the PIMC are addressed. Section 
11.5 gives the primary controller design methods for the PIMC and the MPIMC 
system. Section 11.6 presents the robustness analysis. Several practical issues 
on the PIMC are discussed in Section 11.7. In Section 11.8, simulation results 
are given to demonstrate the PIMC scheme. A real-time implementation is 
presented in Section 11.9. 



11.1 Review of the IMC 

To understand why the IMC scheme fails for unstable processes and how the 
problem can be rectifled, we briefly review the IMC scheme to motivate our 
new control scheme. It is well known (Garcia and Morari, 1982; Garcia and 
Morari, 1985) that an open-loop arrangement represents the best way to achieve 
fast and accurate set-point tracking. For open-loop scheme, the internal sta- 
bility problem, which is complicated in feedback systems, is trivial and the 
controller is easy to design. However, the disadvantages are the sensitivity of 
the performance to process/model mismatch and the inability to cope with un- 
measurable disturbances. To solve these problems, feedback is needed. Based on 
the idea of taking advantage of both open-loop scheme and feedback strategy, 
internal model control structure is proposed (Garcia and Morari, 1982). The 
block diagram of the IMC loop is shown in Figure 11.1, where the process G(s) 
is assumed to be stable, and G(s) is the process model, which is used as the 




Fig. 11.1. General IMC-class scheme. 




11.1 Review of the IMC 321 



internal model. Let r and d be the set-point and load disturbance respectively. 
It follows from Figure 11.1 that 



Gis)K{s) 



-r+- 



1 - G{s)K{s) 



1 + (G(s) - G(s))K(s) 1 + (G(s) - G(s))K(s) 



G(s)d, 



( 11 . 1 ) 



which, under the perfect match G(s) = G(s), is reduced to 



y = G{s)K{s)r+[l-G{s)K{s)]G{s)d. 



( 11 . 2 ) 



Equation (11.2) shows that ‘perfect’ control could be achieved by selecting 
K{s) — G~^{s). However, to ensure internal stability, the controller K{s) 
should be stable. The process model is then factorized as 

G{s) = G^{s)G-{s), (11.3) 

where G'^(s) contains all the time delays and unstable zeros. Consequently, 
1/G~{s) is stable and does not involve predictors. The IMC controller is de- 
signed as 

Kis) = f{s)/G-{s), (11.4) 



where f{s) is a low-pass filter which is chosen such that K(s) is bi-proper. With 
this primary controller, it follows from (11.2) that 

y = G+(s)/(s)r+[l-G+(s)/(s)]G(s)d. (11.5) 

The closed-loop transfer function from r to y, Hyr = G'^{s)f{s), contains only 
part of the process, G~^ . This part limits the achievable control performance, 
but these inherent limitations cannot be removed by any control system. Thus, 
this IMC controller will lead to a perfect controller (Garcia and Morari, 1982). 

If the model is perfect (G{s) = G{s)) and there is no disturbance (d = 0), 
the model output y and the process output y are the same, which causes the 
feedback signal {y — y) to be zero. Thus, when there is no uncertainty, the 
control system becomes an open loop. This shows very instructively that, for 
open-loop stable processes, feedback is needed only because of uncertainty. 

It is this character of the IMC that makes it unable to control the open-loop 
unstable system. The reason is simple: if (G{s) = G{s)) and d = 0, the feed- 
back signal equals zero, which means that the IMC system is open loop and 
becomes unstable for an unstable process. Morari and Zafiriou (1989) pointed 
out that in this case we have to abandon the IMC structure for the control sys- 
tem implementation. They then proposed to use the IMC parametrization for 
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the design of a single-loop controller to control unstable processes. As they still 
used the original IMC idea, i.e., G{s) = G(s), the designed controller has to 
meet some constraints to ensure the single-loop control system is internally sta- 
ble. Rotstein and Lewin (Rotstein and Lewin, 1991; Rotstein and Lewin, 1992) 
used the same idea to tune the PID controller for low-order unstable processes. 
However, when high-order unstable processes are considered, high-order con- 
trollers are usually required with these methods. A simple and practical scheme 
to improve the IMC in this regard is really needed. 



11.2 The Proposed PIMC Scheme 

Unstable processes are always a challenge to control system design. To deal 
with such processes, feedback is always needed and the first issue for the feed- 
back design is to ensure the internal stability of the closed-loop system. The 
idea of using a controller to cancel an unstable process or its unstable poles 
leads to internal instability of the system and should be avoided (Morari and 
Zafiriou, 1989). In addition, control performance and controller simplicity are 
also important for practical applications. Along with these considerations, a 
general control scheme which includes the IMC as a special case is shown in 
Figure 11.1, where F(s) is a pre-filter. In the case G = G, it becomes the IMC. 
In general, however, G may not be the same as G. Our goal here is to find the 
best G for an unstable G in some sense. Recall that the idea of the IMC is 
choosing the internal model G such that internal stabilization of the compen- 
sated process (G — G) by the primary controller K is trivial, the design of K to 
meet performance specifications is easy, and yet the resultant K is simple. This 
can readily be achieved by setting G = G for a stable G. But for an unstable 
G, we note that G cannot have any unstable pole of G for internal stability 
of the closed-loop (this will be shown in Section 11.4). Obviously, we do not 
want G to have any other unstable poles either. If otherwise, the compensated 
process (G — G) has more unstable poles than the process itself, which further 
complicates internal stabilization and primary controller design for (G — G) 
and may cause performance deterioration compared with the control design for 
G. This analysis clearly indicates that only a stable G should be used. 

The goal now is to choose a stable G for an unstable G such that (G — G) 
is as simple as possible in some sense for enhancement of control performance 
and ease of control design and implementation. In the context of control, the 
order of a process is a major measure of simplicity within the set of rational 
transfer functions. A low-order process is usually easier to control than a high- 
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order process if other properties such as stability and damping of these two 
processes are similar. An additional advantage of having a low-order process 
is that a low-order controller is sufficient to meet control specifications. For 
instance, we have two processes, G\ = and G 2 = ( i -iffg+ip ? where c\ 
and C 2 are constants. In a unity negative feedback configuration, a constant 
controller can stabilize G\ and a PI controller can control G\ very well. But it 
can be shown (Wang et aL, 1997 d) that the minimal order of stabilizers for G 2 
is 3. The control design for high-order unstable processes like G 2 is not easy. A 
pole-placement controller of order 4 may be designed for G 2 but it is usually 
sensitive to modelling errors. 

Therefore, our task is now to determine a stable G for a given unstable G 
such that (G — G) has minimal order. To this end, let and A+ be stable and 
unstable poles of G, respectively. The partial fraction expansion of G yields 



G(») = E E 



h: 



ik 



+EE 









/?e(A") < 0, i?e(At) > 0, 

( 11 . 6 ) 



where N^- and N^+ are the multiplicities of the poles at s = A^ and s — 
respectively. Define 









bJ 



ik 






and 






bt 






(11.7) 



( 11 . 8 ) 



One notes that (G — G) always contains unstable poles of G since G has been 
assumed to be stable. The order of (G — G) is thus larger than or equal to 
the number unstable poles of G (multiplicities included) and 

J2j=i ^\+ is a lower bound for the order of (G — G). As a result, the 
stable G which minimizes the order of (G — G) is given by 



G = G“, (11.9) 

since in this case the order of G — G = G^ is just thus reaches 

the lower bound. One sees that G~ is a part but not the whole of the G. Hence, 
the scheme in Figure 11.1 with G = G“ is called the Partial Internal Model 
Control, and abbreviated as the PIMC, to distinguish it from the IMC. 
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As a demonstration, consider an unstable process 
^ (S-1)(S + 1)3’ 

which has a high order of 4 and is difficult to control. G can be expressed via 
the partial fraction expansion as 



1 -.^- 4.-7 

8(5 - 1) 8(5 + 1)3 



G++G-. 



Take G = G ~ , then the compensated process which the primary controller K 
faces is G — G — G^ = ? which is only of first order and is easy to control, 

as discussed above. 

For the control system in Figure 11.1, the closed-loop transfer function is 



, = 

l + Kis){G{s)-G{s)) l + Kis){Gis)-G{s)) 



( 11 . 10 ) 



In the PIMC, G = G~^ -f G , G = G , and the input-output relationship 
becomes 



y = 



G{s)K{s) 

1 + G+(5)K(5) ^ 



l-G-(5)i^(5) 
l + G+(5)i^(5) 



G{s)d. 



( 11 . 11 ) 



Equation (11.11) shows that only the anti-stable part G"^ remains in the loop 
and needs to be stabilized by the controller K{s). Compared with the original 
IMG method, the feedback loop here is used not only for process uncertainty 
but also for stabilization of the process. 

We now consider two extreme cases of the PIMC. If G has no stable poles, 
the partial internal model G = G~ = 0, and Figure 11.1 reduces to a unity 
feedback loop. The controller K{s) is designed with respect to the process G. 
When G is stable, G+ = 0 and G == G~ = G. The PIMC scheme in this case 
becomes the IMC. Thus, the IMC can be regarded as a special case of the 
PIMC. 



11.3 Internal Stability Analysis 

A control system must be stable. In this section, internal stability of the PIMC 
system is analyzed. In the PIMC, the primary controller K is designed with 
respect to G — G = G~^. Let G^ — ^ and AT = £ be polynomial fractions. 
Suppose that K stabilizes G — G = G“^, i.e., q = aa^ + /36i has all its roots in 
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the open left half of the complex plane (LHP) (Chen, 1984). The question is 
whether the PIMC system is internally stable if K stabilizes G — G = G^. 

Recall that a linear time-invariant control system is internally stable if the 
transfer functions between any two points of the system are stable (Morari and 
Zafiriou, 1989). Thus, in order to test for internal stability, the transfer func- 
tions between all possible inputs and outputs should be examined. Accordingly, 
for the PIMC system in Figure 11.1 with G = G“, by introduction of the sig- 
nals w and d, the closed loop is internally stable if and only if the transfer 
matrix H between [y y u]'^ and [r d w]'^ is stable. By a straightforward but 
tedious analysis, it can be shown that this H is indeed stable under our PIMC 
scheme if K stabilizes G — G = G^. A simpler proof can be obtained by an 
easy application of our newly developed theorem on internal stability (Wang et 
aZ., 1999e), and is thus presented below. Before stating the theorem, we need 
the concept of Mason’s system determinant. The determinant of the system is 
defined (Mason, 1956; Franklin et a/., 1994) by 

A = l-Y,Lii + J2^^j-'E^3k + ..., ( 11 - 12 ) 

i j k 

where Lu are the loop gains of the system and L 2 j and L^k are the products 
of 2 and 3 non-touching loop gains. 



Theorem 11.3.1. (Wang et a/., 1999 e) A system with m scalar plants Gi{s) = 
2 = 1, 2 , . . . , m, where ^ are polynomial fractions, is internally stable if and 
only if the characteristic polynomial defined by 

m 

P(s) = Ajjai(s) (11.13) 

i=l 

is a stable polynomial, where A is the system determinant. 



For the PIMC in Figure 11.1 with G = C?-, let G = | = G++G“ = 
and K = ^. Then, it follows from (11.13) that P{s) for this system is given by 






/?&2 



aa~ 



= (aa“^ + /36i)(a ) 



^ / b2 ___i_ 

— ( h — ) > aa a 

a a~ ) 

-\2 



(11.14) 



which is stable if and only if {aa~^ + Pbi) is stable, or if and only if K stabilizes 
G~^ = 1^. Hence, we obtain the following theorem on internal stability of the 
PIMC system. 



Theorem 11.3.2. The PIMC system shown in Figure 11.1 with G — G is 
internally stable if and only if K stabilizes G^ . 
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The following claim is made in Section 11.2 and its proof is given here. 



Theorem 11.3.3. The system in Figure 11,1 is internally unstable if G has 
any unstable pole the same as that of G. 



Proof. Suppose that G and G have a common unstable pole at s = A“^, A+ > 0, 
that is G{s) = follows from (11.13) that 

for P{s) in this case is 



P{s) = [1 - ( 



pb 



pb 



a{s — A+)Sr a(5 — A+)a, 
= [a{s — A“*")ar2r — ^bar + /3bar]{s 



-)]a(s — X^)^arar 

-A+), 



(11.15) 



which is always unstable due to the existence of the unstable factor (s — A+) in 
P{s). By Theorem 11.3.1, the system in Figure 11.1 is thus internally unstable. 



11.4 Asymptotic Tracking and Regulation 



Asymptotic tracking and regulation are always desired properties for industrial 
process control systems. It is noted (Garcia and Morari, 1982) that an implicit 
integral action is included in the standard IMC to achieve zero offset for step 
inputs if and only if A"(0) = G“^(0). The same can be done for the PIMC. To 
see this, Figure 11.1 with G = G~ is redrawn into its equivalent in Figure 11.2, 
where 



K = 



1 



K 

G-^K' 



To generate an integrator in K requires that 



1-G-(0)K(0) = 0, 



or 



K{0) = {G{0))-\ (11.16) 

If (11.16) holds, the output y has zero steady-state error in response to the 
set-point change r and the load disturbance d of step-type (Garcia and Morari, 
1982) provided that the closed loop is stable. 

An alternative scheme for t racking/ regulation using the PIMC is proposed 
in Figure 11.3 and termed Modified PIMC (MPIMC) for ease of reference. 
One will see from below that this MPIMC can automatically achieve asymp- 
totic tracking and regulation for any type of external inputs and removes a 
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Fig. 11.2. Equivalence of PIMC 




Fig. 11.3. Modified partial internal model control system 



(11.16)-like constraint on the controller. For the MPIMC, the controller K is 
constructed as 



K = KiK2. 



(11.17) 



Ki is determined by the internal model principle (Chen, 1984) as 



Ki{s) 



1 

wr 



(11.18) 



where (f){s) is the least common denominator of the anti-stable parts of r{s) 
and d{s), respectively. For example, if both r(s) and d{s) are of step type, then 
r{s) = j and d{s) = j, leading to (j){s) = s and Ki{s) = If either of r and d 
is changed to ramp type, then Ki{s) = We define GKi as the generalized 
process: 

G := GK^ = 

<t> 



(11.19) 
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and expand it as 

G = ( 11 . 20 ) 

where G and ^ are the stable and anti-stable parts of G respectively. Like 
in the PIMC, only G is used in MPIMC as the parallel compensator to cancel 
the stable dynamics of the generalized process, and is required to stabilize 
(G — G ) — We can now establish the following theorem on asymptotic 
tracking and regulation of the MPIMC. 

Theorem 11.4.1. The MPIMC system in Figure 11.3 has a zero steady-state 
error provided that G{s) has no zeros coinciding with roots of (j){s) and K 2 
stabilizes . 

Proof. Under the assumed condition that G{s) has no zeros coinciding with 
roots of (^( 5 ), there is no unstable pole-zero cancellation between G{s) and 
Ki. One may then regard GKi = G as one single process, and the MPIMC in 
Figure 11.3 is a PIMC system. It follows from Theorem 11.3.2 that the MPIMC 
system is internally stable if K 2 stabilizes G — G = ^ . The output error is 
obtained from Figure 11.3 as 

e(s) := r(s)-yis) = Geris)r(s)+Ged{s)d{s), (H-21) 

where 



Ger (^) 



[l-G {s)K2{s)] 

0(s) + [G(s) - <A(s)G“(s)K2(s) 






and 



Gedis) = 



[G{s)-G{s)G (g)JC2(g)] 
^(s) + [G(s)-.^(s)G"(s)K2(s) 



(t>{s). 



Since the system has been shown to be stable, the final value theorem is appli- 
cable: 
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e(oo) = lim s(Ger(s)r(s) + Ged(s)d(s)) 

s-^0 

[1-G~(s)X2(s)] 



= lim s 

s— >0 



— lim s 

s—>0 



[c^(s) + [G(s)-c/>(s)G (s)]ii: 2 (s)J 
[G(5)-G(s)G-(s)i^2(s)] 



= lim s lim 

s — >-0 s — >>0 



L<^(S) + [G(s) - ./.(s)G is)]K 2 {s)\ 
[1 -G-{s)K2{s)] 



[4>is)r(s)] 
[(A(s)d(s)] 



— lim s lim 

s — >0 s — >0 



L<^(s) + [G(s) - <A(s)G is)]K2{s)\ 
[Gis)-G{s)G-{s)K2is)] 



>(s) + [G(s) - <A(s)G (s)]if 2 (s)J 

= 0 • Cl • C2 - 0 • Cs • C4 

= 0 , 



lim[fl!.(s)r(s)] 

s— >^0 



lim[(/.(s)c/(s)] 



where ci, C 2 , cs and C 4 are finite constants. The proof is completed. 



11.5 Primary Control Design 

The design of the primary controller K{s) in PIMC/MPIMC systems is con- 
sidered in this section. For the PIMC in Figure 11.1 with G = the primary 
controller K{s) is determined such that it gives rise to an internally stable 
system, satisfies (11.16) by having zero steady-state error for external inputs 
of step-type, and meets the dynamic performance specifications given by the 
user. For the MPIMC in Figure 11.3, the controller design is the same as for 
the PIMC except that it does not need to satisfy (11.16). It is noted that the 
unstable processes encountered most commonly in industry actually have only 
one unstable pole. Integral processes and chemical reactors are examples. In 
the rest of this section, we assume that the process is described by 

G{s) = (11-22) 

[s — X^)a [s) 

where a~{s) is a stable polynomial. We present an analytical design solution 
for the primary controller for both PIMC and MPIMC in terms of the desired 
closed-loop specifications. A similar solution for the process with two unstable 
poles is given in Appendix A of this chapter. 

11.5.1 PIMC Primary Controller Design 

Consider Figure 11.1 with G = G~ . G in ( 11 . 22 ) can be expanded into 
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-A+ a-(s)' 



(11.23) 



Choose K{s) as 



K{s) = 



k2S + 1 
kis G~ (0) 



(11.24) 



Note that i^(0) = (G“(0))“^ and that such a K{s) satisfies (11.16). Assume 
that the desired closed-loop specifications are given by the following stable 
second-order dynamics: 



Pd{s) = 5^-h2^a;os + u;o. 



(11.25) 



With G — G = G~^ = and K{s) in (11.24), the actual characteristic 

polynomial P{s) for Figure 11.1 with G = G~ is determined using (11.14) as 



k\ k\ 

:= {a~ {s)fkiPc{s). 

We match the adjustable part Pc{s) in P{s) to Pd{s), that is Pc{s) = Pd{s). 
This yields the solution for the remaining controller parameters as 



&i-A+G~(0) 



^{-G-(0) + 



[6i-A+G-(0) 



(11.26) 



^ and (jjQ are important factors for satisfactory behaviour of a system. ^ is the 
resultant system damping factor and is usually chosen as 0.707. A large value 
of cjo results in a fast system response but may require much control effort. 
The selection of uq is usually related to the real part of the unstable pole A"^. 

11.5.2 MPIMC Primary Controller Design 

Consider Figure 11.3 with G in ( 11 . 22 ) and (f>{s) = 5 , which is the most common 
case. The generalized process G = ^ is expanded into 



^ s s(s-A+) a-(s)’ 



(11.27) 



where a~ is a stable polynomial. Formulas for determining /xi, and 62 for 
typical unstable processes can be found in Appendix B of this chapter. K 2 {s) 
is taken as K 2 {s) = kis + k 2 . In this case, the complete primary controller is 



K = K 1 K 2 = 



kis + k2 



(11.28) 
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which is exactly a PI controller. It follows from (11.13) that the closed-loop 
characteristic polynomial for the MPIMC can be obtained as 



P{s) = (a-(s))2(l + 



1 + 



s + 



1 -h kifli 



) 



{a {s))^{l + kiHi)Pc(s), 



(11.29) 



where only Pc is adjustable. Suppose that the desired closed loop is still specified 
by (11.25). Then, we make 



2 , hfJ-2 - A+ + k2^ll , k2H2 

s ; — ; — ; 

1 + 1 + kifii 

whose solution is 



5^ + 2^o;o 5 + cJq , 



(11.30) 



1 

1 




(N 





2^g;o/X2+A'*'/X2— 

^o(/^2+A^^i) 

//f -2Cu;o/i 1 M2 _ 



(11.31) 



11.6 Robustness Analysis 

In the real world where the model does not represent the process exactly, nom- 
inal stability analysis is not sufficient. Stability robustness of the proposed 
PIMC scheme has to be investigated. 

11.6.1 Robust Stability 

Suppose that an actual process is described by G, which is unknown to us. 
What we know is a nominal process (or a model for it), G = + G~( 5 ). Since 

the MPIMC is a special case of PIMC, we need only to consider the PIMC 
system in Figure 11.4 with the internal model G~ and the process described 
by 

n = {G(s) : |G'(S)-G(s)| < (11.32) 

where 7 ( 5 ) is a stable bound function on the additive uncertainty G{s) — G. 

As the standard assumptions in robust analysis, we assume that a primary 
controller K has been designed such that the nominal closed-loop system is 
stable, i.e., K stabilizes G~*", and that G has the same number of unstable poles 
as G. The PIMC system in Figure 11.4 can be re-drawn into Figure 11.5, where 
K = stable. It then follows from the the robust stability theorem 

(Doyle et al, 1982) that the system in Figure 11.5 is robustly stable if and only 
if \\K{G - G)||oo < I5 or ||^7||oo < 1 holds. Therefore, we obtain the following 
result on robust stability of PIMC systems. 
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Fig. H.4. PIMC robust stability analysis 
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fl — fl 








Cj Lt 















Fig. 11.5. Equivalent robust stability analysis scheme for PIMC 

Theorem 11.6.1. A PIMC system is robustly stable if and only if 

ll^(s)7(s)||oo < 1. (11.33) 

11.6.2 Practical Stability 

Palmor (1980) pointed out that there is a ‘practical unstable’ problem in some 
Smith Predictor control system in the sense that a nominally stable Smith sys- 
tem may become unstable when there is an infinitesimal mismatch. The prac- 
tical stability concept (Yamanaka and Shimemura, 1987; Wang et al, 19986) 
addresses this phenomenon. The closed loop is said to be practically stable if 
and only if there exist positive numbers um and a such that the closed loop is 
stable for every process satisfying 
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\G-G\<(j, 0<u;<a;M. (11.34) 

As such, practical stability analysis concerns system stability during an in- 
finitesimal perturbation of the process, or an infinitesimal mismatch between 
the process and the model, and thus is a special case of robust stability. 

If uj is finite, K{ju) is also finite. We can thus choose sufficiently large ujm 
and sufficiently small a such that j{juj) can be made arbitrarily small and 

0 < ^ < (11.35) 

When (jj approaches infinity, one notes that 

lim \K(juj)\ = I lim J < 00 , (11.36) 

o;^oo a;— >-oo 

since K{s) is proper and G~^{s) is strictly proper, and that 
lim \G{joj)-G{juj)\ = 0, 

a?— >oo 



or 



lim 7 (jw) = 0, (11.37) 

01-^00 

if G{s) and G{s) are both strictly proper. Equations (11.36) and (11.37) imply 
that 



Im |ii:(ja;)7(jw)| = 0, (11.38) 

o;— >-oo 

for strictly proper G{s) and G{s). And (11.35) and (11.38) together show that 
||i^7||oo < 1 and the system is stable for every G{s) satisfying (11.34). 

Theorem 11.6.2. The PIMC system of Figure 11. 4 is practically stable if both 
the process G and its model G are strictly proper. 



11.7 Practical Aspects 

In this section, several issues concerning the use of PIMC/MPIMC systems are 
discussed. 

11.7.1 Pre-filter Design 

It is noted that severe overshoot and undershoot may sometimes exist in a 
PIMC for a set-point change. This is caused by improper zeros/poles in the 
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closed-loop transfer function. In order to reduce this, a pre-filter F{s) can be 
placed in front of the closed loop, as shown in Figure 11.1. 

PIMC Case. Consider the most common case in which the process has only 
one unstable pole at s = A"*" and is described by 



G{s) = 



Hs) 

(s - X~^)a~(s) 



5 — A+ Cl~(s) 



G+(s)+G-(s), 



where a~ is a stable polynomial. Suppose that the PIMC primary controller 
K in (11.24) has been obtained. It follows from (11.11) that the closed-loop 
transfer function from r to y is 



Gyr{s) 



G{s)K{s) 

l-t-G^{s)K{s) 

b{s){k2S + 1 ) 

u~(5)[(5 — A“*")(/ci5 G~(0)) H- bi{k2S + 1)] 

b'^ {s)b~ {s){k 2 S + 1) 

u“(s)[(5 — \'^){kis + G~(0)) -f- bi{k2S + 1)] ’ 



where b'^{s) contains all the unstable zeros of b{s). 

The ideal design of the pre-filter F{s) is such that the transfer function 
between r\ and y in Figure 11.1 has exactly the desired second-order dynamics, 
that is. 



Gyr{s)F(s) 



+ 2^0JoS -h ’ 



This requires 



F{s) = 



b (0)a (s) 
a~ {0)b~ {s){k 2 S -f 1) ’ 



But this F{s) may not be proper, and we may thus take F{s) as 



F(s) = 



b (0)a {s) 1 

a~ {0)b~ {s){k2S + 1) {ts + 1)”^ ’ 



(11.39) 



where is chosen such that F{s) is proper. It may be noted that if the 

stable poles of the process are much smaller than cjq, the pre-filter in (11.39) 
will result in a faster set-point response but with much greater control effort. 
To avoid this, the pre-filter can be chosen as 



F{s) = 



b-{0) 

b-{s){k2S + 1 ) ’ 



This rule is also applicable to the following MPIMC case. 
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MPIMC Case. Consider the process with one unstable pole at s = A“^: 



G(s) = 



(5 — A+)a~(s) 



5(.) = ® = r w+G-w = 

s s(s — A^^) a (s) 

It follows from (11.11) and (11.21) that the closed-loop transfer function from 
r to y is obtained as 

^ _ G(s)if(s) 

Cryr(S) — I 

l + G^is)K2(s) 

_ b{s){kis + k2) 

o~(s)[(s - A+)s + {nis + H 2 ){kis + k 2 )\ ' 

Like the PIMC case, F{s) is chosen as 

^ ’ a-{<S)h-{s){kis + k2) (rs + l)™- ^ 



11.7.2 Determination of G 

In order to implement the PIMC, one has to obtain G~ from G. For a complex 
or high-order unstable process, the computation of G~ using the residual the- 
orem is quite involved, especially for the case of multiple poles. Actually, this 
can be avoided. As we know, practical industrial processes usually have only 
one unstable pole. This means that 

G(s) = -\t + G-{s), X+ > 0. 

Then we have 



61 = lim (s-A“^)G(s), (11-41) 

s->\+ 

and 

G-(s) = G(s) A+ > 0 . (11.42) 

The decomposition in (11.41) and (11.42) is sufficient for the PIMC. But, for 
the MPIMC, the generalized process is 
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If A~^ ^0, then 



(11.43) 



/ii and fjL 2 can still be calculated simply by the residual theorem and G is 
thus obtained from (11.43). If A+ = 0, then G has a double pole at the origin. 
However, a simple solution still exists for this case. We express G as 

G{s) = ^ + ^ + G"(s) := ^ + Z{s), 

where /ii is determined by //i = lim^-^o s^G{s) and Z{s) = G{s) — Z{s) = 
^+G (s) has only a single unstable pole at the origin, and fjL 2 can be calculated 
accordingly. Thus, we obtain 

s 



G-{s)=\G)-{^ + ^). 



11.7.3 Dead Time 



We have assumed so far that the process has a rational transfer function G{s). 
If the given unstable process has small dead time, it can be approximated as 



e 



— TS 



Er=i 



Z^i=l i! V 2 / 



(11.44) 



and it contributes additional stable poles to G{s). Partial function expansion 
can then be applied to it. If the process dead time is large, the Finite Spectrum 
Assignment method may be used for dead time compensation (Wang et a/., 
19986). 



11.8 Simulation Results 

In this section, several simulation examples of different kinds of unstable pro- 
cesses are presented to illustrate the PIMC/MPIMC methods. 

Example 11.8.1. Consider the unstable batch reactor of (Rotstein and Lewin, 
1992): 

C( ^ ^ 

(-24425 -hi) (372s -hi)' 
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For the PIMC scheme, the process is decomposed in the form of (11.6) into the 
stable and anti-stable parts as 



G{s) = G+{s)+G-{s) = 



-646.514 -98.486 

-2442s + 1 372s + 1 ' 



With ^ and ujq in (11.25) specified as 0.707 and 0.02 respectively, the primary 
controller K in (11.24) is designed for as 

453.8435+1.000 
~ 762.7s - 98.486 ' 



The pre-filter is also designed using (11.39) to reduce the overshoot in response 
to the set-point change. The pre-filter in (11.39) is designed as 

= 372s + 1 

(453.843s + 1) (10s + 1)' 

The response to a step change in the set-point and a step load disturbance is 
shown in Figure 11.6. The process can also be controlled using the MPIMC. 





Fig. 11.6. PIMC and MPIMC performance 

(solid lines: PIMC/MPIMC; dotted lines: PIMC with pole shift; dashed lines: PIMC 
with gain variation; dash dotted lines: Rotstein and Lewin method) 
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In the case that the set-point and disturbance is of step- type, the generalized 
process in the form of (11.19) is expressed as 



G(s) 



G{s) 

s 



= G+{s)+G-{s) 



2.405 X 10®s - 745 3.664 x 10^ 
s(-2442s + l) 372s + 1 ' 



The primary controller K is designed with respect to G With ^ and uq in 
(11.25) specified as 0.707 and 0.02 respectively, the controller in the form of 
(11.28) is computed from (11.31) as 



K{s) =0.010 + 



2.200 X IQ-^ 
s 



The pre-filter in (11.40) is calculated as 



F{s) 



372s 4- 1 

(453.8435 + 1)(105 + 1)‘ 



The closed-loop response is shown in Figure 11.6, which is the same as the 
response of the system designed using the PIMC scheme. 

For comparison, the PID tuning method using IMC parametrization (Rot- 
stein and Lewin, 1992) is adopted here, the PID controller from that method 
being 



K(s) = 0.0502(1 + -^ + 101.97s). 

6125 

The system response is shown in Figure 11.6 for comparison. Our method has 
a better performance. 

Performance robustness of the proposed method under process perturba- 
tions is also considered. The PID settings are still the same as above. In the 
first case, we change the process gain from 745 to 745 x 2. In the second case, 
the unstable time constant is varied from 2442 to 2442 x 2. The resultant re- 
sponses under these two circumstances are shown in Figure 11.6. The responses 
are quite satisfactory even under process perturbations. 



Example 11.8.2. Consider the high-order unstable process in Shafiei and Shen- 
ton (1994): 

" (s-l)(s + 2.8)3- 
Partial fraction expansion gives 



G(s) = G+(s)+G-(s) = 



0.4921 -0.4921s3 - 4.6253s - 16.1984 

s- 1 ''' (s + 2.8)3 
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With ^ and cjq in (11.25) specified as 0.707 and 1.5, the resultant primary 
controller is computed as 



K{s) = 



4.943s + 1.000 
0.5466s - 0.7379 



and the pre-filter as 

F(s) = Lf t 

'' ’ 2.83 (4.943s -I- l)(0.2s -f- 1)2 ' 

With these settings, the closed-loop response of the PIMC is illustrated in Fig- 
ure 11.7. For the MPIMC scheme, the generalized process is decomposed 
into 

^ _ G{s) _ -0.73795 -f- 0.4921 0 . 73795 ^ + 5.70635 + 12.7301 

s ~ s(s-l) ^ (s -I- 2.8)3 



With the same ^ and wo as above, the primary controller is 



K{s) = 1.179 -H 



0.238 



and the pre-filter is 



F{s) 



(5 + 2.8)3 

2.83(4.9435 + l)(0.25-h 1)2* 



The MPIMC performance is shown in Figure 11.7. The tuning procedure 
described by Shafiei and Shenton (1994) is quite involved and a pre-filter is 
also required there. The performance of his method is also given in Figure 
11.7, which shows that the proposed method has a better response. 



Example 11.8.3. Consider an oscillatory process with one unstable pole: 



G(5) = 



025 

(5^ -h 5 -h 0.4)(5 — 1.5) ^ 



-0.3s 



With (11.44), the dead time is approximated as 

-0.3s ^ ~ 

1-F0.15s‘ 



The process then becomes 



^ 0.25(1 - 0.15s) 

^ ~ (s2 + s + 0.4)(s - 1.5)(1 -I- 0.15s) ■ 



In the case of the PIMC scheme, the process is decomposed into 
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Fig. 11.7. PIMC and MPIMC performance 

(solid lines: PIMC/MPIMC; dashed lines: Shafiei method) 



^ 0.25(1 - 0.15s) 

(s2 + s + 0.4)(s - 1.5)(1 + 0.15s) 

_ 0.0381 -0.0318s2 - 0.3943s - 1.0436 

“s-l.s’*' (s2 + s + 0.4) (s + 6.667) ' 

When ^ and uq are specified as 0.7 and 3, respectively, the primary controller 
is 



20.652s +1.000 
“ 0.069s -0.3913’ 



and the pre-filter is 



F(s) 



0.15s +1 
20.652s +1* 



With these settings, the closed-loop response of the PIMC is illustrated in 
Figure 11.8. When the MPIMC scheme is adopted, the generalized process 
is first expanded into 



r - + 0-625 0.391s^ + 2.961s + 2.415 

s s(s - 1.5) (s^ + s + 0.4) (s + 6.667) ’ 



With the same ^ and uq as above, the primary controller K is determined as 
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Fig. 11.8. PIMC and MPIMC performance 
0 124 

K(s) = 2.536 H . 

s 

The pre-filter is designed as 

0.01865 + 0.124 
~ 2.536s + 0.124 ' 

The control performance using our method is shown in Figure 11.8. Satisfactory 
performance is obtained using the proposed PIMC /MPIMC scheme. 



11.9 Real-time Implementation 

In this section, the proposed PIMC scheme is applied to a motor position 
control pilot-scale system. The system comprises an L. J. Electronics DC motor 
servo apparatus and a PC-based data acquisition system, as shown in Figure 
11.9. The DC motor apparatus diagram is presented in Figure 11.10. It is 
obvious that the transfer function between the control voltage and the position 
in Figure 11.10 is unstable. It is true that a simple controller can be designed 
to realize motor position control due to the simplicity of this motor apparatus. 
Our intention in utilizing this motor apparatus is to demonstrate that our 
scheme is capable of being applied to a real process. 
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Fig. 11.9. A motor servo pilot system 



control 



voltage 




velocity position 



Fig. 11.10. Diagram of the motor apparatus 



The motor apparatus is identified using both open-loop and closed-loop 
tests. First, a step set-point change of control voltage is applied to the open- 
loop motor apparatus. The time constant T is estimated by measuring the 
time for the motor velocity to reach 63.2% of its steady speed (Franklin et 
a/., 1994). Then, a closed loop is formed by feeding back the position signal to 
the reference via a constant controller. When a step set-point change in control 
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voltage occurs, the time for the motor to reach its first peak is measured, 
from which we can calculate /X 1 /X 2 (Franklin et al.^ 1994). The transfer function 
between the reference and the position output is then estimated as 

G(s^ = 

(0.149s +l)s' 

In the proposed PIMC scheme, G(s) is decomposed into 
G(s)=G*(s)+G W = 



Only G (s) is used as the internal model. With ^ and ujq specified as 0.7 and 
7, respectively, the primary controller is computed as 



K{s)^ 



0.349s + 1.000 
0.178s -1.299’ 



and the pre-filter as 



F(s) 



0.149s -I- 1 
0.349s -h 1' 



The experimental result on the position control performance is shown in Figure 
11.11 and is quite good. 




Fig. 11.11. Position control performance under PIMC 
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Appendix A: Controller Design for Processes with Two 

Unstable Poles 



Let the process be represented by 
b{s) 



G{s) = 



= G+(s)+G-(s), 



(s2 + i/is + i/o)a~{s) 
where b{s) is a polynomial and a~{s) is a stable polynomial, 



G+(s) = , 

+ ViS + Vo 



and 



G-{s) = 



h{s) 



a-{s)' 

(i) PIMC Design 



Let 



K = 



k2S^ + k\S + 1 



k/^s^ k^s G (0) 

Then i^(0) = (G(0))“^. Such a controller K automatically satisfies (11.16) and 
has zero offset under step inputs for a stable closed loop. Suppose that the 
desired characteristic polynomial is specified as 

Pd{s) = + + + (11.45) 

The characteristic polynomial of the actual PIMC system is 

P = a~k^[s^ + (z/i + 



,4 , ^ ^ 1/1^3 + -h /ip ^2 + G 



+ 



k^ 

^oks + Ml + Mo^i + ^iG ( 0 ) Mo + i'oG~{0) 



k^ 



k4 



s + 



^4 



a k4,Pc. 

Setting Pc = Pd yields 

0 Ml 1 ^1 0 

Ml Mo ^0 - ot 2 ^2 _ -G~{0) 

Mo 0 uo -ai ks -Mi-^iG^“(0) 

0 0 0 cfo ^4 Mo + ^^oG“(0) 

from which the controller parameters [ki k 2 ks k^]'^ can be determined. The 
pre-filter F is designed in the same way as in Section 11.7.2, and given by 
6“(0)a~(s) 1 



F(s) = 



a~ {0)b~ {s){k 2 s‘^ -h kis -h 1) {rs + l)’^ 
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(ii) MPIMC Design 

Suppose that the primary controller in a MPIMC system is given by 



K = KiK2, 

where Ki = K 2 = generalized process is decomposed as 

^ _ G _ fl2S^ + fJ>lS + /ip ^ ^ 

5 s{s^ 4- 1/iS + I/q) 0'~ 

= G + + G 

Suppose that the desired characteristic polynomial is specified the same as 
(11.45) and is matched by the characteristic polynomial of the actual MPIMC, 
leading to 



0 /i 2 Ml - H20i3 I'l - 0:3 




ko 




-1 


/^2 fj'l /J'O — l^20L2 ^0 — OL2 




ki 




-1/1 


fJ'i fJ'O —fJ'20ii —ai 




k2 






/io 0 -fJi2Oi0 ao 




ks^ 




0 



where the controller parameters [ko ki k 2 ks]^ can be computed. The pre-filter 
in this case is 

^ b-jOjkoa-js) 1 

a-{ 0 )b-{s){k 2 s‘^ -h kis -h ko) {rs + 1)"^ ’ 



Appendix B: Formulas for Decomposition of some Typical 
Unstable Processes 



(i) If the unstable process is given by 



G(.) 



1 /JLq 

s - A+ 5 4- A~ ’ 



A“^ > 0 and A > 0, 



then we have 



G(s) = 



G(s) 



bijs) 62 

5(5 - A+) 5 4- A“ ’ 



where 



61 (s) = 



HiX —Ho Ho 

A-(A+ + A-) A-’ 
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and 



62(5) 



-fllX +/XQ 
A-(A+ + A-)’ 



(ii) If the unstable process is given by 



G{s) 



1 fl2S^ + fJ,iS + fJtQ 
s — A+ + uis + i/Q 



A+ > 0, > 0 and uq > 0, 



then it follows that 

gW = g(£)= W , 

S s{s — A+) + UiS + Uq 



where 



61 (s) = - 6 s + 

Vo 

& 2 (s) = -9s + (/T 2 - ^A'*' - 6ui - — ), 



and 



-/XqA+ - /tpl/j + H^X'^Vq + HiVq 

r'o(A+^ + ui\+ + Vo) 
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Processes with inherently more than one variable at the output to be con- 
trolled are frequently encountered in industry and are known as multivariable 
or multi-input multi-output (MIMO) processes. Interactions usually exist be- 
tween control loops, which account for the renowned difficulty in their control 
compared with single-input single-output (SISO) processes. Depending on the 
application and requirement, multivariable controllers or multi-loop controllers 
can be adopted for MIMO processes. Multi-loop controllers, sometimes known 
as decentralized controllers, have much simpler structures and fewer tuning pa- 
rameters to handle. In addition, in the case of actuator or sensor failure, they 
are relatively easy to stabilize manually, because only one loop is directly af- 
fected by the failure (Palmor et al, 1996; Skogestad and Morari, 1989). Hence 
for processes with modest interactions, multi-loop controllers are often more 
favoured than multivariable controllers. 

Many multi-loop controller design methods have been reported in the litera- 
ture. In the BLT (Biggest Log Modulus Tuning) method presented by Luyben 
(1986), the familiar Ziegler-Nichols rule is modified with the inclusion of a 
detuning factor, which determines the trade-off between stability and perfor- 
mance of the system. Individual controllers are designed for their respective 
loops by first ignoring all interactions. The calculated controller gains are then 
scaled by the detuning factor to guarantee stability. Despite the simple com- 
putations involved, the design regards interactions as elements obstructing sys- 
tem stability and attempts to dispose of them rather than control them to 
speed up individual loops. It is hence too conservative to exploit process struc- 
tures and characteristics for the best achievable performance. In the sequential 
loop closing method, loops are closed one after another, with those previously 
closed fitted with appropriate controllers. The interactions are well taken care 
of only if the loops are of considerably different bandwidths and the closing se- 
quence starts from the fastest loop. This assumption of high gains in the loops 
that have already been closed can rarely be justified, except at low frequen- 
cies (Maciejowski, 1989). There are some other existing methods which need 




348 12. Decentralized Control 



iterations. The designer changes the trade-off between conflicting constraints 
by adjusting certain inequalities or objective functions (Maciejowski, 1989; Za- 
kian, 1979) until satisfactory response is obtained. As with all other iterative 
designs, the major drawback with these methods is the initial estimate and 
convergence problem. 

In this chapter, a simple independent design method for multi-loop con- 
trollers is presented which exploits process interactions for the improvement 
of loop performance. Unlike many other methods that emphasize suppression 
of interactions for decoupling purposes, our method is developed to channel 
the effect of interactions to individual loops to speed up loop responses. This 
is achieved by regarding each loop together with its corresponding interac- 
tions from all other loops as an equivalent single-input single-output (SISO) 
plant, and designing an independent SISO controller for it. Once an objective 
transfer function is specified for each of these equivalent processes, a set of 
simultaneous equations is formed and separated into independent ones, each 
of which contains one controller element only. They are then solved to obtain 
exact solutions, which are usually irrational. The exact solutions can be well 
approximated by rational functions. The popular multi-loop PID controllers 
can naturally be obtained as a special case of rational approximation, and they 
give a reasonable trade-off between loop and decoupling performance. Simula- 
tion examples are provided to show the effectiveness of the proposed method, 
and comparisons are made with the BLT method. 

This chapter is organized as follows. In Section 12.1, the proposed method 
is presented. A detailed discussion on the choice of solutions to the controller 
gain equations is given in Section 12.2. The rational function approximation 
method follows in Section 12.3. In Section 12.4, the reduction of controller 
structure to the PID format is investigated. Section 12.5 focuses on stability 
analysis of the feedback system. Extension of the proposed method to the m 
by m case is provided in Section 12.6. Simulation examples are included in the 
various sections for illustrations. 



12.1 The Proposed Independent Design Strategy 

Consider a stable 2x2 process described via the transfer function matrix G{s) 
as Y{s) = G{s)U{s) or 



yi(s) 




5ii(s) gnis) 




Ui{s) 


J/2(s)_ 




_52 i ( s ) 922{s)_ 




_U2(s)_ 



( 12 . 1 ) 
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Assume that proper input-output pairing has been made for the process. If the 
process is inherently poorly paired, the RGA (Relative Gain Array) method 
(Maciejowski, 1989) can be employed to make the necessary arrangement. The 
process is to be controlled by a multi-loop controller with the structure: 



K{s) 



ki (s) 0 

0 k 2 (s) 



( 12 . 2 ) 



The resultant control system is shown in Figure 12.1. The controller design 
objective is to find ^1(5) and k 2 (s) such that both loops achieve satisfactory 
performance. The boxed portion in Figure 12.1 can be viewed as an individual 




Fig. 12.1. Equivalent gi(s) for a 2 x 2 plant 



SISO process with an equivalent transfer function gi (s) between input ui and 
output gi. It follows that gi(s) can be obtained (Maciejowski, 1989) as 



^2912921 

9i — 9n - tTT • 

1 + K2922 

Similarly, the equivalent plant between U 2 and 92 is given by 



kl92l9l2 

92 = 922 - 7— 7 • 

1 + ki9ii 



(12.3) 



(12.4) 



In principle, ki{s) and k 2 {s) should be designed for ^i(s) and 92 {s) respectively. 
But the generalized process 91 is a function of k 2 as seen from (12.3), and there- 
fore we cannot design the controller k\ for it unless ^2 is known beforehand. 
Similarly, to design ^2 requires ki to be known. Hence, these conditions fall 
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into a loop and are the main difficulty in multi-loop controller deign. A com- 
mon way of solving this problem is by iterations (Maciejowski, 1989). Here, we 
introduce a new method which needs no iterations and therefore does not suffer 
the convergence problem. The performance specifications on individual closed 
loops may be formulated in terms of the desired closed-loop transfer functions: 



^di — 



(jj^e 



5^ H- 2^iUJiS H- 



2 ’ 



i = l,2. 



(12.5) 



The corresponding desired open-loop transfer functions are 



Qd, = T^-, » = 1>2. (12.6) 

1 - hdi 

The ki are designed to match the actual open loops giki to the desired open- 
loops Qd^: 

u _ f ^2912921 \ u - _ 

^ V ^ 1 + A:2P22/ ^ _^2^io;i5 + a;f(l -e“^^i)’ 

(12.7) 

, _ / ki9i292i \ 

92 2 - (^^^22 ^ J 2 9d2 ^2 2^2^25 + o;|(l - • 

( 12 . 8 ) 

This pair of coupling equations are solved to obtain the following two decoupled 
equations: 

[(1 + qd2)9ii^]kl + [(1 - qdi9d2)9ii922 + (te - qdi)^]ki 

+ [—(1 + qd2)qdl922] = 0, (12.9) 

[(1 + qdi)922^]kl + [(1 - qdiqd2)9ii922 + {qdi — te)A]A:2 

+ [“(1 + ^dl)^d2^1l] — 0, (12.10) 

where 



A = pll^22 - 912921- 



( 12 . 11 ) 



Therefore, each gain ki can be determined separately by solving the correspond- 
ing single quadratic equation. 

The values of { 001 , 002 }^ {Ti,L 2 } and {^ 1 ,^ 2 } have to be determined before 
(12.9) and (12.10) are solved for A:i(5) and ^(s). It is found from simulations 
that in general suitable values of ui lie between 0.6 and 0.8 times the critical 
frequencies u)ci[^9ii[j^ci) — of the respective diagonal elements 9 u{s) . As 
a guideline, this is taken to be 0.7 times as default. The value of Li is chosen 
to be the equivalent dead time r* in the element 9 u . For gu of order higher 
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than one, ti can be approximated by fitting gu into the first-order plus dead 
time model gu{s) = at the point s = 0 and s = jujci, or obtained 

equivalently from the equation: 



Ti = 






UJc 



( 12 . 12 ) 



The damping ratios {^1,^2} are all set to 0.707 for a fair trade-off between 
speed and the amount of overshoot. Hence, we recommend 



(jJi — 0 . 7 cc ^ c 2 , I 

= 0.707, > 



i = l,2. 



Li — Ti. 



(12.13) 



12.2 Choice of Solutions to Controller Gain Equations 

In general, (12.9) or (12.10) has multiple or two solutions at each frequency 
point s = jujj^ j = 1, 2, . . . , A^. Every solution satisfies the corresponding equa- 
tion from a mathematical point of view. However, when stability is concerned, 
one solution has to be discarded. In order to address this problem, typical so- 
lutions to (12.9) are plotted in the complex plane as shown in Figure 12.2. 
Similar treatment can be applied to (12.10). Since ki{s) has two solutions, two 
branches are shown in Figure 12.2. According to the Nyquist stability criterion, 
for a stable open-loop system there has to be no encirclement of the point — 1 by 
the Nyquist plot of the loop gain as joj travels along the imaginary axis, to en- 
sure closed-loop stability. To suppress the steady-state error in response to step 
inputs, integrators have to be present in ki and k 2 . Owing to these explicitly 
introduced poles in the controllers at the origin, the Nyquist path is modified to 
bypass the origin by making a semi-circular turn of infinitesimal radius to the 
right of the origin so that the contour engulfs the entire right half complex plane 
except the origin. Since lim5^oo[^i(5)fci(5)] = 0, lims^o+,rea/bi(^)^i(5)] has 
to be positive in order not to have any encirclement of the point —1. It follows 
that if lims^o+,rea/bi(^)] > O5 then lim5_^o+,rea/[^i(^)] has to be positive, or 
equivalently ki (s) has to start from negative infinity in the complex plane. Ow- 
ing to the presence of an integrator in ^2(5), we have lim5_^o+,rea/[fe(^)] = 00. 
It can then be readily evaluated from (12.3) that hm5^o+,rea/[Pi(^)] equals 
^ii(Q)_ Conversely, if lim*_,o+,reaib2(s)] = 522(G)- < 0, 

then lims_^o+,rea/[^i(^)] has to be negative, and thus A:i(s) has to start from 
positive infinity in the complex plane. 




352 



12. Decentralized Control 



\rts 




Fig. 12.2. Nyquist plot of controller gain ki{s) 

Suppose lim*_^o+,reoi[9i(s)] = 911(0) - < 0. Based on the above 

argument, branch 1 in Figure 12.2 should be chosen as the solution. Unlike in 
the above discussion on the choice of branches for the stability of the closed 
loop, we now shift our focus to the stability of the controller itself. In order 
to have all poles and zeros of the controller ki{s) in the left half complex 
plane, the Nyquist plot of the controller ki{s) should have no encirclement of 
the origin. Following the earlier argument that lim 5 ^o+,rea/bi(^)] < 0 requires 
lims^o+,rea/[^i(^)] < ki{s) should cut the negative real axis at some high 
frequency for the plot not to encircle the origin. As observed from Figure 12.2, 
branch 1 heads towards the real axis initially but detours on the way, and shows 
no sign of cutting the negative real axis as frequency advances. On the contrary, 
branch 2 turns towards the negative real axis in its late stage. As a result, if 
we break branch 1 halfway and join it to branch 2, the resulting hybrid branch 
will make the correct crossing and ensure stable controller poles and zeros. To 
minimize the gap caused by branch jumping, the break point is chosen to be 
the point where the two branches are nearest to each other. The re-combined 
solution branch is shown as a solid line in Figure 12.2, which starts with branch 
1 and ends with 2. It forms the ultimate solution to (12.9) where stability is 
guaranteed. It is noted from (12.7) and (12.8) that ^2(5) is dependent on fci(s). 
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Hence whenever there is branch jumping in ki{s), a corresponding branch jump 
should also be performed on k 2 {s). 

This analysis leads to the following rules for the solution selection: 

(i) For each i, if gi{0) > 0, the solution should be chosen so that ki{ju) for 
a very small uj has an imaginary part at negative infinity. It should cross the 
positive real axis as the frequency approaches infinity. If that is not satisfied, 
branch hopping has to be carried out at the point where the chosen branch 
is nearest to some other branch that cuts the real positive axis at infinite 
frequency. 

(ii) Likewise, if Qi{0) < 0, the imaginary part of ki{juj) for very small uj 
should be located at positive infinity and should intersect the negative real 
axis by possible switching among the solution branches. 

In the above discussion, we base solution selection on the assumption of 
having a stable open loop (stable equivalent process gi{s) and controller ki{s)), 
as a result of which there must be no encirclement of the point —1 for closed- 
loop stability according to the Nyquist stability criterion. For the 2x2 case, 
there are two solutions for each ki{s) and k2{s). If the alternative solutions are 
selected or no branch jumping is performed, there will be encirclements of the 
point —1. However, it is noticed that closed-loop stability can still be guaran- 
teed in such cases if the open loop makes the same number of encirclements 
of the origin. If the equivalent processes are all open-loop stable, these encir- 
clements must be contributed by unstable poles and zeros of the controllers. 
This in practice is not desirable although closed-loop stability is still achieved, 
because it results in only a conditionally stable system, where an uncondition- 
ally stable system is usually preferred if possible. Hence, in our method, only 
stable controllers are considered. 

To further illustrate how the solutions can be selected, we now look at some 
popularly used examples. In all the examples, the objective transfer functions 
Qdi and Qd 2 are obtained according to the default settings given in (12.13). 

Example 12.2.1. Consider the eight-tray + reboiler distillation column sepa- 
rating methanol and water studied by Wood and Berry (Luyben, 1986). The 
transfer function matrix is given by 



G{s) 



12.8e~^ -18.9e~^^ 

165-|-1 21 s -|-1 

6.6e~'^^ -19.4e~^^ 

10.9 S +1 14.4 S +1 



The elements gn and ^22 have critical frequencies of 1.62 rad/s and 0.58 rad/s 
and equivalent dead times of 1 s and 3 s respectively. The objective transfer 
functions are thus set according to (12.13) as 
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Imag 




Imag 




Fig. 12.3. Approximation of controller gains by rational functions in Example 12.2.1 



^ 1.1342e-* 

~ + 2^ia;is + w?(l - ~ s'^ + 1.414 x 1.134s + 1.1342(1 - e~^) ’ 

_ 0.4042e-3* 

+ 2^2UJ2S + ulil - ~ s2 + 1.414 x 0.406s + 0.4062(1 - e-^*) ' 

The values of ki{s) and k 2 {s) are then calculated at s = juj using (12.9) and 
(12.10) and are plotted in Figure 12.3. There are two roots for each of them, 
corresponding to the two branches shown in dashed lines and dotted lines 
in the figure. Since lims^-o+,reai[5i(s)] = 511(0) - = 6.4 > 0 and 

lims_^o+,rea([52(s)] = 522(0) - = ~9-7 < 0, branches 1 and 3 are 

chosen as the solutions at low frequency. However, they do not move towards 
the real axis for intersection at high frequency. Therefore, the solutions have 
to hop to branches 2 and 4 at the nearest points. The resulting Nyquist plots 
for the final solution are given in solid lines. 



Example 12.2.2. The 24-tray tower separating methanol and water examined 
by Vinante and Luyben (Luyben, 1986) has the following transfer function 
matrix: 



G{s) 



-2.2e~^ 

7s+l 7s+l 

9.5S+1 9.2S+1 
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Following the rules, we obtain ki{ju)) and k 2 {juj) as shown in Figure 12.4. 
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Fig. 12.4. Approximation of controller gains by rational functions in Example 12.2.2 



Example 12.2.3. The process studied by Wardle and Wood (Luyben, 1986) has 
the following transfer function matrix: 



G(s) = 



0.126e~^^ -0.101e~^^^ 

60s+l (48s+l)(45s+l) 

0.094e~^^ -0.12e~^^ 



38s+l 



35s+l 



ki{juo) and k 2 {juj) are computed and the selected solutions are shown in Figure 
12.5. 



12.3 Rational Approximation of the Irrational Solutions 

It should be noted that the solutions obtained in Section 12.2 and selected in 
Section 12.3 are irrational in general, i.e., such a solution k{juj) may not have a 
rational function realization. For practical implementation, a rational function 
approximation k{s) is required to approximate a possible irrational k{s). The 
problem at hand is to find a rational function: 
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Fig. 12.5. Approximation of controller gains by rational functions in Example 12.2.3 



k(s) = 



^ + ... + 60 

s'^ an-is'^~^ ais 



(12.14) 



where an integrator has been imposed in k{s) to match that of k{s) such that 
the approximation error e defined as 






j=l 



(12.15) 



meets 



\e^g{0)\<e, (12.16) 

where p(0) is the equivalent process g{s) at zero frequency and e is a speci- 
fied threshold and usually takes the value 0.1 ~ 0.15. We do not set a direct 
constraint on the error e because processes with high gains are usually fitted 
with controllers having relatively small gains, which naturally lead to smaller 
error e. Hence, the absolute error is scaled by the static gain of the equivalent 
process for a more reasonable evaluation of the approximation. The recursive 
least squares algorithm presented in Chapter 7 can then be used to solve this 
rational approximation problem. The data points in ki and ^2 used for the 
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approximation should stretch from positive/negative infinity to somewhere in 
close proximity to the real axis so as to capture the general trends at high 
frequencies. Usually these points can be conveniently taken from the frequency 
range (0, min{uJci,0Oci})^ where Ud as defined earlier corresponds to the crit- 
ical frequency of the element gu of the process. The range is usually sufficient 
unless and k 2 make sharp turns at high frequencies. 

This method provides a general framework for the design of rational function 
controllers. Note that PID controllers can be viewed as a special case of rational 
function controllers with the order of numerator and denominator being two 
and one respectively. It is noted that although nonlinear least squares and 
stochastic (or statistical) methods may also be used, they demand far more 
computational resources and hence are not recommended. 

We shall now apply the approximation method to demonstrate its effective- 
ness. Comparisons will be made with the well-known BLT design introduced 
by Luyben (1986) to show how our method can improve control performance. 
A threshold of 0.1 is set in (12.16) for the determination of controller orders. 



Example 12.2.1 (cont’d). The recursive least squares method is then used to 
compute the coefficients of the rational function. Since minjcjci, ^c 2 } = 0.58 
rad/s, and the general trend at high frequencies is well exhibited in the range 
(0,0.58) rad/s, the points in this range are used for the approximation. This 
results in the multi-loop controller: 

fm -0.0904s^ - 0.0196s2 - 0.00262s - 0.000257 
K(s) = d.ag I + 0 . 0640 .^ + 0 . 0156 » 

where 



ni = 0.485s^ + 0.318s® -h 0.117s® -h 0.0249s^ + 0.00391s^ -h 0.000469s^ 
-h0.0000340s + 0.00000229, 

di = s^-h0.453s®-h0.218s®+0.0264s^+0.0054s^+0.000301s2+0.0000327s. 



The error-gain products \e • ^(0)| as defined in (12.16) are 0.054 and 0.049 for 
ki{s) and A: 2 (s), respectively. Their Nyquist plots are shown in Figure 12.3 and 
close fitting is achieved. The step response of the feedback system using the 
above controller is shown in Figure 12.6. For comparison, the step response 
using the BLT method with 



Kblt{s) = diag 






is also given in the figure. It is observed that the proposed method has sig- 
nificant improvement in the loop performance. To ease the assessment of con- 
troller performance, the performance index ISE (Integral Square Error) with 
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Fig. 12.6. Step response for Example 12.2.1 

(solid lines: proposed method; dashed lines: BLT method) 



equal weighting of the two outputs are calculated for the proposed and BLT 
methods as 10.2 and 18.22, respectively. Figure 12.7 shows the Nyquist plots 
of the equivalent open-loop gains. It is seen that they are reasonably close to 
the desired values. The dashed lines show those of the corresponding gikBLTi 
and g 2 kBLT 2 - 

Example 12.2.2 (cont’d). The solid lines in Figure 12.4 show the Nyquist 
plots of the controller gains obtained using rational function approximation, 
and they are extremely close to the exact gains given by the dashed lines. The 
controller is 

K{s) = 

f -1.03s^ - l.SOs^ - 0.735s3 - 0.453fi2 - 0.0951s - 0.00651 na ) 

\ s5 + 0.664s4 + 0.391s3 + 0.166s2 + 0.0191s ’ da J ' 

where 

na = 2.76s^ + 1.76s® + 2.92s® + l.Us"* + 0.963s® + 0.217s® + 0.101s + 0.0100, 
da = s^ + 0.696s® + 0.872s® + 0.380s‘‘ + 0.240s® + 0.0519s® + 0.0210s. 
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Fig. 12.7. Nyquist plot of equivalent open-loop gains in Example 12.2.1 



The step response of the feedback system is shown in Figure 12.8. As seen from 
the figure, the proposed controller gives very much better loop performance 
than the BLT method with 



Kblt{s) — diag 



_1.07(I + ^), 1.97(1 + ^) 



and the performance index ISE of the proposed and BLT methods is calculated 
as 3.09 and 3.86, respectively. The corresponding Nyquist plots of the equivalent 
open-loop gains are given in Figure 12.9. 



Example 12.2.3 (cont’d). Following the same procedure, the controller de- 
signed is 



f 11.3s^ + 18.45^ + 15.153 + 1.21s2-f 0.0414s + 0.000473 
(5) - lag I 0.7305^ + 0.37753 + 0.O3OI52 -h 0.0002805 

-8.555^ - 7.I653 - 2.425^ - 0.09955 - 0.00216] 

54 -h 0.34853 -h O.I3I52 -f 0.001615 J ‘ 



The points used for the approximation lie in the frequency range {0, 0.8} since 
there is a sharp turn in both fci and ^2 at frequencies above min{a;ci5^c2} = 
0.16 rad/s. Close fitting of the approximate gains to the exact gains is seen in 
Figure 12.5. The step response of the feedback system is shown in Figure 12.10. 




360 12. Decentralized Control 





Fig. 12.8. Step response for Example 12.2.2 

(solid lines: proposed method; dashed lines: BLT method) 
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Fig. 12.9. Nyquist plot of equivalent open-loop gains in Example 12.2.2 
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Fig. 12.10. Step response for Example 12.2.3 

(solid lines: proposed method; dashed lines: BLT method) 



Excellent response is obtained as seen from the figure when compared with the 
BLT method with 



Kblt{s) = diag 






1 

52.95 



) • 



The performance index ISE of the proposed and BLT methods is calculated 
as 39.1 and 56.4, respectively. The approximate open-loop gains using the pro- 
posed controller are remarkably close to the desired values as shown in Figure 

12 . 11 . 



12.4 Controller Reduction and Performance Trade-ofF 

It is observed from the above results that although the individual loop per- 
formances have been significantly improved, the closed-loop coupling between 
the loops may sometimes be still too large. The reason is that our design has 
focused solely on loop performance and paid no attention to decoupling perfor- 
mance. It is possible to enhance the latter at the expense of the former. This 
can easily be achieved by increasing the value of e in (12.16) which gives rise 
to lower orders of ki{s). An additional advantage of such a design trade-off 
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Fig. 12.11. Nyquist plot of equivalent open-loop gains in Example 12.2.3 



is that low-order controllers are cheaper and easier to implement. The most 
widely used and commercially available low-order controllers are the PID type. 
In our framework of the rational function approximation method described 
above, multi-loop PID controllers can be obtained simply by specifying the or- 
ders of the numerator and denominator as two and one respectively (note that 
an integrator has already been explicitly implemented in the algorithm). Fur- 
thermore, for this particular PID controller structure, we can directly apply the 
linear least squares method in the frequency domain instead of the recursive 
least squares approach. 

Let the multi-loop controller be of PID type for loop i 



ki{s) = kpi + kii- + kDiS 
s 




kpi 

kji 

kpi 



(12.17) 



Its parameters are determined to match ki{s) as closely as possible in the 
frequency domain. As shown in Section 2 of Chapter 9, the standard linear 
least squares method can then be applied to give the required PID parameters. 
Based on extensive simulations, the objective transfer functions Qdi in (12.5) 
and (12.6) in this case are recommended to have the following settings: 
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— ^ci I 

- 0.707 > 



i = 1,2. 



Li =Ti \ 



(12.18) 



We now apply the method to the same plants and compare the PID controller 
performance with that of rational function controllers. 



Example 12.2.1 (cont’d). The bandwidths of the objective transfer functions 
are set to be the critical frequencies of the diagonal elements gu and p 22 , i^e., 
ui = 1.62 rad/s and 002 = 0.58 rad/s, so that 



Qdl 

Qd2 



,2^-sLi 



odfe 
-h 2^iuoiS + 



uj^e 



-SL 2 



+ 2^2(^2 S + w |(1 - 



1 . 622 e-* 

s2 + 1.414 X 1.62s + 1.622(1 - e-») ’ 

O.SS^e-^* 

s2 + 1.414 X 0.58s + 0.582(1 - e-3«) ' 



We next compute the controller gains ki and k 2 in the usual way and approxi- 
mate them by PID controllers using the linear least squares method introduced 
above. The approximation results are shown in Figure 12.12. The multi-loop 
PID controller is obtained as 



K{s) = diag 



0.571 -F -f- 0.581s, -0.113 - 
s 



0.020 

s 



0.119s . 



The step response of the feedback system is shown in Figure 12.13. The step 
response using the BLT method is shown as dashed lines in the figure. The 
performance index ISE of the proposed and BLT methods is calculated as 
8.2 and 18.22, respectively. It is observed that the proposed method (solid 
lines) gives better loop performance and shorter settling time for the couplings. 
Although the loop performance is not as good as that using rational function 
controllers, the decoupling capability is better than the former. 



Example 12.2.2 (cont’d). With the proposed method, we obtain k\ and k 2 as 

AT(s) = diag [-1.929-^^, 2.919-b^^-b0.283s], 

whose Nyquist plots are shown in Figure 12.14. The step response of the feed- 
back system is shown in Figure 12.15. The proposed PID controller shows better 
loop performance and coupling response than the BLT method in loop 1 and 
they are comparable in loop 2. The performance index ISE of the proposed and 
BLT methods is calculated as 2.63 and 3.86, respectively. It is again observed 
that although the PID controller does not generate loop performance as good as 
that given by the rational function controller, it can handle interactions better. 
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Fig. 12.12. Approximation of controller gains by PID in Example 12.2.1 





Fig. 12.13. Step response for Example 12.2.1 

(solid lines: proposed method; dashed lines: BLT method) 
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Fig. 12.14. Approximation of controller gains by PID in Example 12.2.2 





Fig. 12.15. Step response for Example 12.2.2 

(solid lines: proposed method; dashed lines: BLT method) 
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Fig. 12.16. Approximation of controller gains by PID in Example 12.2.3 



Example 12.2.3 (cont’d). It follows from our method that 



K{s) = diag 



41.6 -h -I- 75.5s, -19.4 - 
s 



1.13 

s 



56.45 . 



Figure 12.16 shows the PID approximation to the exact solutions. Figure 12.17 
shows the step response of the feedback. The performance index ISE of the 
proposed and BLT methods is calculated as 33.2 and 56.4, respectively. More 
satisfactory response is obtained than that given by the BLT method in both 
loops. 



12,5 Stability Analysis 

In the proposed method, we design ki to stabilize the equivalent process gi for 
each i. In this section, we shall investigate whether the stabilization of all gi 
by the corresponding ki leads to an overall stable closed loop, i.e., whether it 
implies that K{s) stabilizes G{s) . 

We shall now give a simple counter-example to show that the above impli- 
cation is in fact incorrect. Suppose that all elements i = 1, 2, of a 2 x 2 
process are stable but at least one of the elements gij, i ^ j, is unstable. If 
the controllers k\ = k 2 = 0 are adopted, we shall have gi = gu for all i. 
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Fig. 12.17. Step response for Example 12.2.3 

(solid lines: proposed method; dashed Lines: BLT method) 



Then although all ki stabilize gi, the whole system is still unstable because the 
controller holds the system in open loop and the open-loop system is unstable. 

Owing to the above observation, it would be of much interest to find out 
the conditions for closed-loop stability given that k{ stabilizes gi. Let p{g) be 
the characteristic polynomial of a transfer function g{s) and set p{g) = 1 if g{s) 
has no pole at all. 



Lemma 12 . 5 . 1 . (Rosenhrock, 1974 ) • For a unity negative feedback system with 
the plant G{s) and the controller K{s), K stabilizes G if and only if pc := 
p{g)p{K)det{I GK) has stable roots only. 



In our case of G = 


^11 912 


, K = 


h 


0 




921 922 




0 


k 2 



Pc - p{G)p{ki)p{k2) det[I-\-GK], ( 12 . 19 ) 



where 



det{I-\-GK) = l-\-giiki-^g22k2+giikig22k2-kig2igi2k2^ ( 12 . 20 ) 



Now suppose that fci (respectively ^2) stabilizes gi (respectively ^2) where 




368 12. Decentralized Control 



^ 2 ^ 125^21 

9i -511 , 

kig2i9i2 

This implies by Lemma 12.5.1 that both 
Pel = pi9i)p{ki){i+9iki) 

and 



( 12 . 21 ) 

( 12 . 22 ) 



(12.23) 



Pc2 = Pi92)p{k2){l+92k2) 



(12.24) 



are stable. The question is whether or not this individually stabilized system 
is stable, i.e. whether or not stability of pd and Pc2 are equivalent to stability 
of Pc- Now, bringing (12.21) into (12.23) yields 

Pel = p{9i)p(ki) ^^^^^ ' (12.25) 

Substituting (12.25) into (12.19) yields 



„,^,5(fc2)(l + A:2522) 

Pc — PciPyG) / N • (12.26) 

p{9i) 

Noting that p{k2){l H- ^2922) — (12.26) can be rewritten as 

Pc=Pci5(G)^hdtfc|^. (12.27) 

Lemma 12.5.2. Assume that a 2x2 process G{s) is individually stabilized by 
ki and k2, i.e. pd and Pc2 stable. Then, the resultant feedback system is 
stable if and only if 



P(G) 



p{ 



k2 \ 

l + fc2g22 ' 



5(51 ) 



has stable roots only. 



(12.28) 



By applying this lemma to the previous example where pu are all stable 
with k\ = k2 = ^ while pij are not, one sees that p(pi) = p(pii) is stable, 
p{ ijXlg22 ^ ~ unstable. It follows that (12.28) is violated and the 

system is unstable. 

It is, however, noted that most industrial processes are stable. If G is now 
restricted to be stable, p{G) is stable and it follows from (12.21) that all the 
unstable factors in will be cancelled by those of p(pi), leading to the 

satisfaction of (12.28), provided that 



k2 

1 + 1^2922 



None of the unstable poles of 



are cancelled by 912921 • (12.29) 
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Theorem 12.5.1. Assume that a stable 2x2 process is individually stabilized 
by ki and k 2 - Then the resultant feedback system is stable if and only if (12.29) 
holds. In particular, this is the case if (i) both gi 2 and Q 2 i are of minimum 
phase; or (ii) k 2 stabilizes ^ 22 * 

It should be pointed out that if we start with k 2 and follow the same devel- 
opment above, we shall arrive at dual results to the above Lemma 12.5.2 and 
Theorem 12.5.1, in which ^ 2 , 9i and ^22 in (12.28) and (12.29) are replaced 
by ki, Q 2 and gn respectively. Another important observation is that (12.29) 
generically holds because k 2 is designed for g 2 and the probability of unsta- 
ble poles of coinciding with unstable zeros of ^ 12^21 is almost zero. 

Therefore, we can conclude that one almost always produces an internally sta- 
ble system when sequential stabilizing design is used for a stable process. This 
conclusion is intuitively appealing and practically evidenced. It is the case, in- 
deed, for all three design examples illustrated earlier. But one should be careful 
if an unstable process is concerned. 

A very nice thing with the above stability results is that stability robustness 
can also be addressed in the same framework. For a stable process with uncer- 
tainty, (12.29) is very unlikely to be violated by uncertain G{s) and instead it 
can be assumed to hold. As a result, for a stable G, the closed loop is robustly 
stable if and only if ki stabilizes the uncertain gi, which can be checked by 
drawing the Nyquist bands of gi{juj)ki{juj) for a given uncertainty bound on 
G(j(jj) and counting the number of encirclements of the critical point. 
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The above discussions can easily be extended to the general m x m plants. 
Equations governing the plant dynamics are 



yi 




9ii • 


Qlm 




Ui 


Um _ 




_9ml * ■ 


1 




'^m 



This is controlled by 



Ui 




1 

0 


• 0 ' 




ei 


U2 


- 


0 k2 ■ 


• 0 




62 


_Um _ 




1 

0 

0 


* km _ 




_ _ 



(12.30) 



(12.31) 
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Since all loops are closed, we can write 
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Ui-l 


9i+i 




1 

ki-\-i 




'^i+1 






0 






. . 
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Substitution of (12.34) into (12.33) yields 
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(12.33) 



(12.34) 



(12.35) 
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Therefore, we have 
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or in short 
Vi — 



(12.36) 



( 12 . 37 ) 



for a suitable gi. Difficulties arise in designing controllers for each of the equiv- 
alent processes gi for each is a function of fci, /?2, . . • , that 

is 



9i — 9i{ki , j • • • 5 ki—i , ki^i , . . . , km)- (12.38) 

However, fci, ^2, • • • ? fcj+i , . . . ,km, can be designed to meet user specifica- 
tions so that the dependence of on fci, fe? • • • , . . . ,km is released, 

i.e.. 



2 -.Li 



Pl(fc2,fc3, . . . ,km-l,km)ki — s^+2CiuJis-^(jjl{l-e-^^i) ~ 



9i(kl 5 • • • 5 ki —\ , kiJ^i , . . . , km)ki — s^+2^iUJiS+uj\l—e~^^i ) ~ 



9mikl , A^25 • • • 5 A^m-2 5 J 

( 12 . 39 ) 

Thus there are m equations and m unknowns, namely ki,k2, - - - ,km, and they 
can be solved with some manipulations. The separation process starts with 
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expressing ki in terms oi k 2 , • . . ,km and qdi using the first equation in (12.39), 
to obtain 



h = fi{k2,h , . . . , kffi—i , kuij Qdi). (12.40) 

The expression is next substituted into the second equation in (12.39) and ^2 
can then be written in terms of kz, ... ,km and qdi,Qd 2 , he. 

h = f2{h, . . . , km—i , kjnj 9di,te). (12.41) 



The same procedure is repeated and we shall subsequently obtain 

^3 — • • • 5 ^m — 15 Qdl^ Qd2j Qds)j 1 



^m— 1 — /m— 1 (^m? Qdl^ Qd2^ • • • ? Qdm—l)y 
— fmiQdl^ Qd2^ - • • ^ Qdm—1^ Qdm) • ^ 



(12.42) 



It is noticed that, km has been recovered in the last equation of the above set. 
Independent expressions for ^2,^3 ,... and km-i can be acquired using back 
substitution as follows. The recovered km is substituted into the second last 
equation in (12.42) for km-i- The recovered km and km-i are next substituted 
into the third last equation for km- 2 - The same process is repeated until ^2 is 
finally recovered. 

According to the trade-off between loop performance and controller com- 
plexity as discussed in Section 12.4, rational function controllers or PID con- 
trollers can be designed similarly for m x m processes. Guidelines for the se- 
lection of the values {ct;i, . . . , (^m}, {Ti,...,L^} and in (12.39) 

follow exactly those for the 2x2 case. Depending on the type of controllers 
used, (12.13) or (12.18) is applied accordingly. It should also be noted that the 
rules for the selection of solutions in Section 12.3 still hold in the mxm case. 

The major increase in workload arising from extension of the proposed 
method from the 2 x 2 to the mxm case lies in computation of the m solutions to 
the m-degree polynomial equations. The solutions become much more involved 
but can be solved with the help of well-developed software such as Matlab. 
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